elk收集分析nginx日志
2022/8/17 5:24:34
本文主要是介绍elk收集分析nginx日志,对大家解决编程问题具有一定的参考价值,需要的程序猿们随着小编来一起学习吧!
修改nginx配置
把nginx日志修改成json格式,在nginx.conf中添加如下内容,重启nginx。
log_format log_json '{"@timestamp":"$time_iso8601",' '"http_host":"$http_host",' '"clientip":"$remote_addr",' '"request":"$request",' '"status":"$status",' '"size":"$body_bytes_sent",' '"upstream_addr":"$upstream_addr",' '"upstream_status":"$upstream_status",' '"upstream_response_time":"$upstream_response_time",' '"request_time":"$request_time",' '"http_referer":"$http_referer",' '"http_user_agent":"$http_user_agent",' '"http_x_forwarded_for":"$http_x_forwarded_for"}';
安装logstash
打开国内加速下载地址 https://mirrors.huaweicloud.com/logstash/ 安装你想要的版本,适合的操作系统。我的centos7直接下载rpm包后rpm -ivh logstash-7.17.2-x86_64.rpm
添加logstash配置
进入/etc/logstash/conf.d 添加nginx.conf配置,需要注意的是索引名字必须为logstash开头,在绘制地图图形的时候才可以正常使用。
input { file { path => "/www/wwwlogs/*access" start_position => "end" exclude => "*.gz" type => "access_log" } file { path => "/www/wwwlogs/*error" start_position => "end" exclude => "*.gz" type => "error_log" } } filter { json { source => "message" } grok { match => { "message" => "%{COMBINEDAPACHELOG}"} } geoip { source => "clientip" database =>"/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-filter-geoip-7.2.12-java/vendor/GeoLite2-City.mmdb" add_field => ["[geoip][coordinates]","%{[geoip][longitude]}"] # 获取经度 add_field => ["[geoip][coordinates]","%{[geoip][latitude]}"] # 获取纬度 fields => ["country_name","region_name","location"] } mutate { convert => ["[geoip][coordinates]","float"] # 修改经纬度为浮点数 } } output { #stdout { # codec => rubydebug #} if "access_log" in [type] { elasticsearch { hosts => ["10.128.0.116:9200"] index => "logstash-nginx-access-%{+YYYY.MM.dd}" } } if "error_log" in [type] { elasticsearch { hosts => ["10.128.0.116:9200"] index => "logstash-nginx-error-%{+YYYY.MM.dd}" } } }
安装elasticsearch kibana
方法同上,自己看着弄吧。记得优化kibana启动内存,elasticsearch的jvm.options配置。免得太卡。
配置kibana
这篇关于elk收集分析nginx日志的文章就介绍到这儿,希望我们推荐的文章对大家有所帮助,也希望大家多多支持为之网!
- 2024-03-29fail2ban nginx
- 2024-03-18install nginx proxy manager
- 2024-01-2444从零开始用Rust编写nginx,命令行参数的设计与解析及说明
- 2024-01-22比Nginx更好用的Gateway!
- 2024-01-17nginx daemon off
- 2023-12-30Nginx Vhost Traffic Status 是什么意思-icode9专业技术文章分享
- 2023-12-26使用nginx搭建creates.io镜像(稀疏索引)
- 2023-11-18centos7编译安装Nginx教程。
- 2023-11-02nginx启动命令和停止命令
- 2023-10-25Centos7系统Nginx负载均衡如何安装和配置?