使用awk统计netstat结果 统计当前各种状态的连接总数:
|
1 2 3 4 5 6 7 8 |
[root@test ~]# netstat -anlpt | awk 'BEGIN{printf "%12s\t%s\n","State","Total_Nums"} {if (NR>2) a[$6]++} END {for(i in a){printf "%12s\t%i\n",i,a[i] | "sort -k 1"}}' State Total_Nums CLOSE_WAIT 5 ESTABLISHED 181 LISTEN 36 SYN_RECV 1 TIME_WAIT 356 [root@test ~]# |
netstat -anlpt 显示当前计算机所有的TCP连接 BEGIN{printf “%12s\t%s\n”,”State”,”Total_Nums”} 在处理开始前 […]
由于MySQL自带的Binlog日志只记录操作语句，而General Log也是多记录个操作用户，并无记录执行的机器IP地址，故写了此脚本来进行抓包。 从抓取的数据包中截取想要得到的信息并进行日志记录:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
#/bin/bash # Author:Chris __by 2017/08/29 # ==============Description============== # This is for Capture MySQL Data Traffic & Log it. # ======================================= # Defined Color Red='\033[31m\033[1m' # \e[1;31m Green='\033[32m\033[1m' # \e[1;32m Blue='\033[94m' # \e[0;94m Null='\033[0m' # \e[0m # <----------------------------Configure Start---------------------------> # <---TCPDUMP Settings---> Interface="ens160" My_Port=3306 Protocol="mysql" # <---Filter Settings---> Filter="CREATE|DROP|INSERT|DELETE|UPDATE|ALTER|SHOW" # <---Log Settings---> Date=$(date +%Y-%m-%d) Log_Dir="/data/mysql/logs" mkdir -p ${Log_Dir} Log_File="${Log_Dir}/tcpdump.${Date}.log" # <----------------------------Configure End----------------------------> pid=$(ps -ef | awk -v Port="${My_Port}" '/^tcpdump/ && $0 ~ $Port {print $2}') until [ -z "${pid}" ] do echo -e "${Red}MySQL Capture is Running(${pid})...${Null}" if [ "$1" == "1" ];then echo -e "Killing The Process!" kill ${pid} break fi exit 1 done echo -e "Capture MySQL Data at port ${Red}${My_Port}${Null} on ${Green}${Interface}${Null}" /usr/sbin/tcpdump -i ${Interface} -qs0 -ttttnn -A dst port ${My_Port} and ${Protocol} and "tcp[13] & 8 != 0" and greater 75 | sed 's/\r//g' | awk 'BEGIN{ORS=""} /^[0-9]{4,}/ {if (FNR!=1) a="\n"; time=a$1" "$2" "$4" "$5" "$6"\n"} /^[^0-9]/ {gsub(/^\s*/,"");sql=$0} {if (time !~ /^[\s| ]*$/) {print time;time=""} else if (sql ~ /\S/ && sql !~ /^\s*.{2}\..*\.$/) {print sql;sql=""}}' | sed -e 's/^\s*.*\.\{4,\}\([a-zA-Z\/]\)/\1/g' -e 's/\/\*.*\*\///g' | awk 'BEGIN{ORS=""} /^[0-9]{4,}/{t="\n"$0} /^[^0-9]/{s=$0} {print t,s;t="";s=""}' | sed -e '/.*:\s*$/d' | awk -v recode="${Filter}" 'BEGIN{IGNORECASE=1} {if ($6 ~ recode) print $0}' >> ${Log_File} & if [ "$?" -eq "0" ];then echo -e "${Green}Capture Complate,You can check log in file ${Log_File}${Null}" else echo -e "${Red}Capture Faild,Please Check Configure!${Null}" fi |
指定抓取的接口和MySQL监听的端口和协议，然后就可以抓取所有发到服务器的所有MySQL协议的数据包 -s 0抓取所有大小的数据包 […]
Nginx自带没有日志轮循功能，需要借助系统logrotate或自写脚本实现，下面是使用脚本来实现:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 |
#!/bin/bash # Author:Chris __On 2016/10/28 # =====================Description===================== # [Features]: Nginx logrotate & Backup Logs. # [Usage]: Add a scheduled task: # 0 0 * * * /root/Scripts/logrotate_nginx.sh # ===================================================== # Defined Color Red='\033[31m\033[1m' # \e[1;31m Green='\033[32m\033[1m' # \e[1;32m Blue='\033[94m' # \e[0;94m Null='\033[0m' # \e[0m # <----------------------------Configure Start---------------------------> Logdir="/data/nginx/logs" Bakdir="/data/backup/logs/nginx" Pidfile="/data/nginx/logs/nginx.pid" Pid=$(cat ${Pidfile}) Date=$(date -d yesterday +%Y-%m-%d) Rather=8192 # <----------------------------Configure End----------------------------> Checkdo (){ if [ "$?" -ne 0 ];then echo -n . echo -e "[ ${Red}NO${Null} ]" echo -e "${Red}Execte Faild.${Null}" exit 1 fi echo -n . echo -e "[ ${Green}OK${Null} ]" } echo -e Starting Nginx logrotate in dir: ${Blue}${Logdir}${Null}... echo -n 1.Detect Directory.. if [ ! -d ${Logdir} ];then echo -n . echo -e "[ ${Red}NO${Null} ]" echo -e "${Red}Log directory ${Logdir} is not exist.${Null}" exit 1 fi if [ ! -d ${Bakdir} ];then mkdir -p ${Bakdir} fi echo -n . echo -e "[ ${Green}OK${Null} ]" # Rotate Log. echo -n 2.Rotating log.. cd ${Logdir} ls -l | grep -E .log$ \ | while read line do fsize=$(echo $line | awk '{print $5}') fname=$(echo $line | awk '{print $NF}') lname=${Date}-${fname} if [ "${fsize}" -lt "${Rather}" ];then continue fi mv ${fname} ${Bakdir}/${lname} done Checkdo # Send USR1 signal to Nginx. echo -n 3.Send USR1 singal to Nginx.. kill -USR1 ${Pid} > /dev/null 2>&1 Checkdo # Compress log files. echo -n 4.Compressing log files.. cd ${Bakdir} tar czf ${Date}.tar.gz ${Date}-* --remove-files Checkdo echo -e "${Green}Logrorate Complated!${Null}" |
思路：将日志文件移动出来，然后给Nginx发出USR1指令（因为Nginx是按文件的inode来写入日志的）。
Linux下可以使用mail和sendmail命令进行邮件发送，这两个命令各有特点，下面就来看看: 发送纯文本格式普通邮件 mail命令 mail命令非系统自带，需安装:
|
1 |
[root@master ~]# yum install -y mailx |
命令格式:
|
1 |
mail [-BDdEFintv~] [-s subject] [-a attachment ] [-c cc-addr] [-b bcc-addr] [-r from-addr] [-h hops] [-A account] [-S variable[=value]] to-addr |
常用参数有: -s 指定邮件标题；-a 指定邮件附件；-r 指定发件人邮箱地址。 邮 […]
由于脚本需要，可能会涉及到小数判断，如：
|
1 2 |
[root@fm1 logs]# ls -lh . | awk '{print $NF "\t" $5}' | sort -h -k 2 -r | grep G$ | awk '{print $NF}' | sed 's/G//' 3.5 |
但SHELL默认的判断中只支持整数判断，如：
|
1 2 3 4 |
[root@fm1 logs]# if [[ 11 -ge 10 ]];then echo "true";else echo "flase";fi true [root@fm1 logs]# if (( 11 >= 10 ));then echo "true";else echo "flase";fi true |
当对象是小数时就会报错：
|
1 2 3 4 5 6 |
[root@fm1 logs]# if [[ 3.5 -ge 10 ]];then echo "true";else echo "flase";fi -bash: [[: 3.5: syntax error: invalid arithmetic operator (error token is ".5") flase [root@fm1 logs]# if (( 3.5 >= 10 ));then echo "true";else echo "flase";fi -bash: ((: 3.5 >= 10 : syntax error: invalid arithmetic operator (error token is ".5 >= 10 ") flase |
这时可以使用bc命令，bc是一个计算器，Bash内置了对整数四则运算的支持，但是并不支持 […]
最近完善优化inotify脚本，由于队列长时会有很长等待，于是考虑多线程实现。 由于所要执行的程序本身就是在循环里面的，所以以下面脚本示例：
|
1 |
[root@Test ~]# vim t.sh |
|
1 2 3 4 5 6 7 8 9 10 11 12 13 |
#!/bin/bash get_time () { date +%H:%M:%S | awk -F : '{print $1*3600 + $2*60 + $3}' } pre_time=`get_time` for i in {1..10} do last_time=`get_time` sleep 3 now_time=`get_time` dint=$((${now_time} - ${last_time})) echo cycle $i use time $dint total use time $((${now_time} - ${pre_time})) done |
|
1 2 3 4 5 6 7 8 9 10 11 12 |
[root@Test ~]# chmod +x t.sh [root@Test ~]# ./t.sh cycle 1 use time 3 total use time 3 cycle 2 use time 3 total use time 6 cycle 3 use time 3 total use time 9 cycle 4 use time 3 total use time 12 cycle 5 use time 3 total use time 15 cycle 6 use time 3 total use time 18 cycle 7 use time 3 total use time 21 cycle 8 use time 3 total use time 24 cycle 9 use time 3 total use time 27 cycle 10 use time 3 total use time 30 |
可以看到循环10次用了30秒，shell脚本中实现多线程的方 […]
