Linux運維Nginx訪問日誌(access_log)配置實戰
Nginx訪問日誌(access_log)
Nginx訪問日誌介紹
Nginx軟體會把每個使用者訪問網站的日誌資訊記錄到指定的日誌檔案裡,供網站提供者分析使用者的瀏覽行為等,此功能由ngx_http_log_module模組負責。對應的官方地址為:http://nginx.org/en/docs/http/ngx_http_log_module.html。
訪問日誌引數
Nginx的訪問日誌主要由兩個引數控制。
Nginx日誌格式中預設的引數配置如下:
log_format main '$remote_addr - $remote_user[$time_local]"$request " '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
Nginx記錄日誌的預設引數配置如下:
access_log logs/access.log main;
訪問日誌配置說明
1.日誌格式的定義說明
先來看其語法:
定義語法: log_format name string ……;
其配置位置在http標籤內。
日誌格式說明如下:
log_format main '$remote_addr - $remote_user [$time_local]"$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
其中,log_format為日誌格式關鍵引數,不能變。
main是為日誌格式指定的標籤,記錄日誌時通過這個main標籤選擇指定的格式。其後所接的所有內容都是可以記錄的日誌資訊,具體見表5-5。注意,所有的日誌段以空格分隔,一行可以記錄多個,不同列的意義:
在沒有特殊要求的情況下,採用預設的配置即可,更多可以設定的記錄日誌資訊的變數見:
http://nginx.org/en/docs/http/ngx_http_log_module.html
2.記錄日誌的access_log引數說明
下面是有關access_log引數的官方說明。
語法如下:
access_log path[format[buffer=size[flush=time]][if=condition]];
access_log path format gzip[=level][buffer=size][flush=time][if=condition];
access_log syslog:server=address[,parameter=value][format[if=condition]];
buffer=size為存放訪問日誌的緩衝區大小,flush=time為將緩衝區的日誌刷到磁碟的時間,gzip[=level]表示壓縮級別,[if=condition]表示其他條件。一般的場景中,這些引數都無須配置,極端優化時才可能會考慮這些引數。
access_log off中的off,表示不記錄訪問日誌。
預設配置:access_log logs/access.log combined;
放置位置在http、server、location、if in location、limit_except中。
訪問日誌配置實戰
編輯主配置檔案 nginx.conf ,配置日誌格式如下:
[root@private conf]# sed -n '21, 23 s/#//gp' nginx.conf.default
log_format main '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
[root@private conf]# vim nginx.conf
[root@private conf]# cat -n nginx.conf
1
2 #user nobody;
3 worker_processes 1;
4
5 error_log logs/error.log error;
6 error_log logs/error.log warn;
7 error_log logs/error.log crit;
8
9 #pid logs/nginx.pid;
10
11
12 events {
13 worker_connections 1024;
14 }
15
16
17 http {
18 include mime.types;
19 default_type application/octet-stream;
20
21 log_format main '$remote_addr - $remote_user [$time_local] "$request" '
22 '$status $body_bytes_sent "$http_referer" '
23 '"$http_user_agent" "$http_x_forwarded_for"';
24 sendfile on;
25
26 keepalive_timeout 65;
27
28 include extra/*.conf;
29
30 }
31
[root@private conf]#
然後在每個虛擬主機裡進行配置,使其商用上述格式記錄使用者訪問日誌。命令如下:
[root@private conf]# vim extra/blog.conf
[root@private conf]# cat -n extra/blog.conf
1 server {
2 listen 80;
3 server_name blog.haiyuan.org;
4
5 location / {
6 root html/blog;
7 index index.html index.htm;
8 }
9
10 error_page 404 /404.html;
11 location = /404.html {
12 root html/blog;
13 }
14
15 error_page 500 502 503 504 /50x.html;
16 location = /50x.html {
17 root html/blog;
18 }
19 access_log logs/access_blog.log main;
20 }
如果不指定日誌格式就會用預設的combined格式記錄日誌。
接下來進行檢查語法,重新載入配置,命令如下:
[root@private conf]# nginx -t
nginx: the configuration file /usr/local/nginx/conf/nginx.conf syntax is ok
nginx: configuration file /usr/local/nginx/conf/nginx.conf test is successful
[root@private conf]# /etc/init.d/nginx reload
reload nginx [OK]
[root@private conf]#
進行測試訪問,檢視日誌結果:
[root@private conf]# curl -I blog.haiyuan.org
HTTP/1.1 200 OK
Server: nginx/1.12.0
Date: Sat, 21 Oct 2017 06:39:45 GMT
Content-Type: text/html
Content-Length: 9480
Last-Modified: Sat, 02 Sep 2017 07:31:30 GMT
Connection: keep-alive
ETag: "59aa5e52-2508"
Accept-Ranges: bytes
[root@private conf]# ls -l ../logs/access_blog.log
-rw-r--r-- 1 root root 904 Oct 21 14:39 ../logs/access_blog.log
[root@private conf]# tailf -5 ../logs/access_blog.log
127.0.0.1 - - [21/Oct/2017:14:38:56 +0800] "GET / HTTP/1.1" 200 9480 "-" "curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2" "-"
127.0.0.1 - - [21/Oct/2017:14:39:07 +0800] "GET / HTTP/1.1" 200 9480 "-" "curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2" "-"
再分別使用谷歌和火狐瀏覽器進行測試訪問,分別檢視日誌結果:
火狐瀏覽器訪問後:
[root@private conf]# tailf -5 ../logs/access_blog.log
119.90.20.254 - - [21/Oct/2017:14:44:32 +0800] "GET /images/templatemo_180_column_bg.jpg HTTP/1.1" 200 2140 "http://114.115.155.144/templatemo_style.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
119.90.20.254 - - [21/Oct/2017:14:44:32 +0800] "GET /images/templatemo_bottom_panel_bg.jpg HTTP/1.1" 200 27926 "http://114.115.155.144/templatemo_style.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
119.90.20.254 - - [21/Oct/2017:14:44:32 +0800] "GET /images/templatemo_top_bg.jpg HTTP/1.1" 200 57124 "http://114.115.155.144/templatemo_style.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
119.90.20.254 - - [21/Oct/2017:14:44:33 +0800] "GET /favicon.ico HTTP/1.1" 404 19 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
119.90.20.254 - - [21/Oct/2017:14:44:33 +0800] "GET /favicon.ico HTTP/1.1" 404 19 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
谷歌瀏覽器訪問後:
[root@private conf]# tailf -5 ../logs/access_blog.log
119.90.20.254 - - [21/Oct/2017:14:44:32 +0800] "GET /images/templatemo_top_bg.jpg HTTP/1.1" 200 57124 "http://114.115.155.144/templatemo_style.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
119.90.20.254 - - [21/Oct/2017:14:44:33 +0800] "GET /favicon.ico HTTP/1.1" 404 19 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
119.90.20.254 - - [21/Oct/2017:14:44:33 +0800] "GET /favicon.ico HTTP/1.1" 404 19 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
119.90.20.254 - - [21/Oct/2017:14:45:09 +0800] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36" "-"
119.90.20.254 - - [21/Oct/2017:14:45:09 +0800] "GET /images/templatemo_main_bg.jpg HTTP/1.1" 404 19 "http://114.115.155.144/templatemo_style.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36" "-"
我們可以將日誌格式和日誌內容做一個比對:
'$remote_addr - $remote_user[$time_local]"$request" ' '$status$body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
真實的日誌內容如下:
119.90.20.254 - - [21/Oct/2017:14:44:32 +0800] "GET /images/templatemo_180_column_bg.jpg HTTP/1.1" 200 2140 "http://114.115.155.144/templatemo_style.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0" "-"
對應說明如下:
- $remote_addr對應的是真實日誌裡的119.90.20.254,即客戶端的IP。
- $remote_user對應的是第二個中槓“-”,沒有遠端使用者,所以用“-”填充。
- [$time_local]對應的是[21/Oct/2017:14:44:32 +0800]。
- “$request”對應的是”GET /images/templatemo_180_column_bg.jpg HTTP/1.1”。
- $status對應的是200狀態碼,200表示正常訪問。
- $body_bytes_sent對應的是2140位元組,即響應body的大小。
- “$http_user_agent”對應的是”Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Firefox/56.0”。
- “$http_x_forwarded_for”對應的是”-“,因為Web服務沒有使用代理,因此此處為”-“。