百度360必应搜狗淘宝本站头条
python类型转换python串口编程python计时python异常python进度条
当前位置：网站首页 > 技术资源 > 正文

一文教会你如何使用 iLogtail SPL 处理日志

off999 2025-01-21 20:37 22 浏览 0 评论

随着流式处理的发展，出现了越来越多的工具和语言，使得数据处理变得更加高效、灵活和易用。在此背景下，SLS 推出了 SPL(SLS Processing Language) 语法，以此统一查询、端上处理、数据加工等的语法，保证了数据处理的灵活性。iLogtail 作为日志、时序数据采集器，在 2.0 版本中，全面支持了 SPL 。本文对处理插件进行了梳理，介绍了如何编写 SPL 语句，从插件处理模式迁移到 2.0 版本的 SPL 处理模式，帮助用户实现更加灵活的端上数据处理。

SPL




Cloud Native

iLogtail 一共支持 3 种处理模式。

  • 原生插件模式：由 C++ 实现的原生插件，性能最强。
  • 拓展插件模式：由 Go 实现的拓展插件，提供了丰富的生态，足够灵活。
  • SPL 模式：随着 iLogtail 2.0 在 C++ 处理插件中支持了 SPL 的处理能力，对数据处理能力带来了很大的提升，兼顾性能与灵活性。用户只需要编写 SPL 语句，即可以利用 SPL 的计算能力，完成对数据的处理。SPL 语法可以参考：https://help.aliyun.com/zh/sls/user-guide/spl-syntax/


特点

开发门槛

原生插件

  • C++ 实现
  • 性能高，资源开销极低
  • 较完善的算子能力
  • C++，开发门槛中等
  • 可灵活定制

扩展插件

  • Golang 实现
  • 较高的性能，资源开销低
  • 较完善的算子能力
  • Golang，开发门槛低
  • 可灵活定制

SPL

  • C++ 实现
  • 性能高，资源开销低
  • 全面的算子能力
  • 灵活组合
  • 暂未开源，但是通过语法可解决大部分问题，免去编码。

总的来说，iLogtail 2.0 + SPL 主要有以下的优势：

  1. 统一数据处理语言：对于同样一种格式的数据，用户可以在不同场景中使用同一种语言进行处理，提高了数据处理的效率
  2. 查询处理更高效：SPL 对弱结构化数据友好，同时 SPL 主要算子由 C++ 实现，接近 iLogtail 1.X 版本的原生性能
  3. 丰富的工具和函数：SPL 提供了丰富的内置函数和算子，用户可以更加灵活地进行组合
  4. 简单易学：SPL 属于一种低代码语言，用户可以快速上手，日志搜索、处理一气呵成

接下来，本文将介绍如何用灵活的 SPL 语句，实现其他两种处理模式相同的处理能力。

原生插件对比




Cloud Native


正则解析

根据正则提取提取字段。输入 Nginx 格式：

127.0.0.1 - - [07/Jul/2022:10:43:30 +0800] "POST /PutData?Category=YunOsAccountOpLog" 0.024 18204 200 37 "-" "aliyun-sdk-java"
原有插件：enable: true

inputs:

  - Type: input_file

    FilePaths: 

      - /workspaces/ilogtal/debug/simple.log

processors:

  - Type: processor_parse_regex_native

    SourceKey: content

    Regex: ([\d\.]+) \S+ \S+ \[(\S+) \S+\] \"(\w+) ([^\\"]*)\" ([\d\.]+) (\d+) (\d+) (\d+|-) \"([^\\"]*)\" \"([^\\"]*)\"

    Keys:

      - ip

      - time

      - method

      - url

      - request_time

      - request_length

      - status

      - length

      - ref_url

      - browser

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-regexp content, '([\d\.]+) \S+ \S+ \[(\S+) \S+\] \"(\w+) ([^\\"]*)\" ([\d\.]+) (\d+) (\d+) (\d+|-) \"([^\\"]*)\" \"([^\\"]*)\"' as ip, time, method, url, request_time, request_length, status, length, ref_url, browser

      | project-away content

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
输出：{

    "ip": "127.0.0.1",

    "time": "07/Jul/2022:10:43:30",

    "method": "POST",

    "url": "/PutData?Category=YunOsAccountOpLog",

    "request_time": "0.024",

    "request_length": "18204",

    "status": "200",

    "length": "37",

    "ref_url": "-",

    "browser": "aliyun-sdk-java",

    "__time__": "1713184059"

}


分隔符解析

根据分隔符分隔提取字段，输入：

127.0.0.1,07/Jul/2022:10:43:30 +0800,POST,PutData Category=YunOsAccountOpLog,0.024,18204,200,37,-,aliyun-sdk-java
原有插件：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_parse_delimiter_native

    SourceKey: content

    Separator: ","

    Quote: '"'

    Keys:

      - ip

      - time

      - method

      - url

      - request_time

      - request_length

      - status

      - length

      - ref_url

      - browser

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-csv content as ip, time, method, url, request_time, request_length, status, length, ref_url, browser

      | project-away content

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
输出：{

    "ip": "127.0.0.1",

    "time": "07/Jul/2022:10:43:30 +0800",

    "method": "POST",

    "url": "PutData?Category=YunOsAccountOpLog",

    "request_time": "0.024",

    "request_length": "18204",

    "status": "200",

    "length": "37",

    "ref_url": "-",

    "browser": "aliyun-sdk-java",

    "__time__": "1713231487"

}


Json 解析

解析 json 格式日志，输入：

{"url": "POST /PutData?Category=YunOsAccountOpLog HTTP/1.1","ip": "10.200.98.220",

    "user-agent": "aliyun-sdk-java",

    "request": "{\"status\":\"200\",\"latency\":\"18204\"}",

    "time": "07/Jul/2022:10:30:28",

    "__time__": "1713237315"

}
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_parse_json_native

    SourceKey: content

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-json content

      | project-away content

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
输出：{    "url": "POST /PutData?Category=YunOsAccountOpLog HTTP/1.1",

    "ip": "10.200.98.220",

    "user-agent": "aliyun-sdk-java",

    "request": "{\"status\":\"200\",\"latency\":\"18204\"}",

    "time": "07/Jul/2022:10:30:28",

    "__time__": "1713237315"

}


正则解析+时间解析

根据正则表达式解析字段，并将其中的一个字段解析成日志时间，输入：

127.0.0.1,07/Jul/2022:10:43:30 +0800,POST,PutData Category=YunOsAccountOpLog,0.024,18204,200,37,-,aliyun-sdk-java
原有插件：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_parse_regex_native

    SourceKey: content

    Regex: ([\d\.]+) \S+ \S+ \[(\S+) \S+\] \"(\w+) ([^\\"]*)\" ([\d\.]+) (\d+) (\d+) (\d+|-) \"([^\\"]*)\" \"([^\\"]*)\"

    Keys:

      - ip

      - time

      - method

      - url

      - request_time

      - request_length

      - status

      - length

      - ref_url

      - browser

  - Type: processor_parse_timestamp_native

    SourceKey: time

    SourceFormat: '%Y-%m-%dT%H:%M:%S'

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      * 

      | parse-regexp content, '([\d\.]+) \S+ \S+ \[(\S+)\] \"(\w+) ([^\\"]*)\" ([\d\.]+) (\d+) (\d+) (\d+|-) \"([^\\"]*)\" \"([^\\"]*)\"' as ip, time, method, url, request_time, request_length, status, length, ref_url, browser

      | extend ts=date_parse(time, '%Y-%m-%d %H:%i:%S')

      | extend __time__=cast(to_unixtime(ts) as INTEGER)

      | project-away ts

      | project-away content

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
输出：{

    "ip": "127.0.0.1",

    "time": "07/Jul/2022:10:43:30 +0800",

    "method": "POST",

    "url": "PutData?Category=YunOsAccountOpLog",

    "request_time": "0.024",

    "request_length": "18204",

    "status": "200",

    "length": "37",

    "ref_url": "-",

    "browser": "aliyun-sdk-java",

    "__time__": "1713231487"

}


正则解析+过滤

根据正则表达式解析字段，并根据解析后的字段值过滤日志。输入：

127.0.0.1 - - [07/Jul/2022:10:43:30 +0800] "POST /PutData?Category=YunOsAccountOpLog" 0.024 18204 200 37 "-" "aliyun-sdk-java"
127.0.0.1 - - [07/Jul/2022:10:44:30 +0800] "Get /PutData?Category=YunOsAccountOpLog" 0.024 18204 200 37 "-" "aliyun-sdk-java"
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_parse_regex_native

    SourceKey: content

    Regex: ([\d\.]+) \S+ \S+ \[(\S+) \S+\] \"(\w+) ([^\\"]*)\" ([\d\.]+) (\d+) (\d+) (\d+|-) \"([^\\"]*)\" \"([^\\"]*)\"

    Keys:

      - ip

      - time

      - method

      - url

      - request_time

      - request_length

      - status

      - length

      - ref_url

      - browser

  - Type: processor_filter_regex_native

    FilterKey:

      - method

      - status

    FilterRegex:

      - ^(POST|PUT)$

      - ^200$

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-regexp content, '([\d\.]+) \S+ \S+ \[(\S+) \S+\] \"(\w+) ([^\\"]*)\" ([\d\.]+) (\d+) (\d+) (\d+|-) \"([^\\"]*)\" \"([^\\"]*)\"' as ip, time, method, url, request_time, request_length, status, length, ref_url, browser

      | project-away content

      | where regexp_like(method, '^(POST|PUT)#39;) and regexp_like(status, '^200#39;)

flushers:

  - Type: flusher_stdout

    OnlyStdout: true输出：
{
    "ip": "127.0.0.1",
    "time": "07/Jul/2022:10:43:30",
    "method": "POST",
    "url": "/PutData?Category=YunOsAccountOpLog",
    "request_time": "0.024",
    "request_length": "18204",
    "status": "200",
    "length": "37",
    "ref_url": "-",
    "browser": "aliyun-sdk-java",
    "__time__": "1713238839"
}


脱敏

将日志中的敏感信息脱敏。输入：

{"account":"1812213231432969","password":"04a23f38"}
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_desensitize_native

    SourceKey: content

    Method: const

    ReplacingString: "******"

    ContentPatternBeforeReplacedString: 'password":"'

    ReplacedContentPattern: '[^"]+'

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-regexp content, 'password":"(\S+)"' as password

      | extend content=replace(content, password, '******')

flushers:

  - Type: flusher_stdout

    OnlyStdout: true输出：
{

    "content": "{\"account\":\"1812213231432969\",\"password\":\"******\"}",

    "__time__": "1713239305"

}

拓展插件对比




Cloud Native


添加字段

在输出结果中添加字段，输入：

this is a test log
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_add_fields

    Fields:

      service: A

    IgnoreIfExist: false

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | extend service='A'

flushers:

  - Type: flusher_stdout

    OnlyStdout: true


输出：
{

    "content": "this is a test log",

    "service": "A",

    "__time__": "1713240293"

}


Json 解析+丢弃字段

解析 json 并删除解析后的指定字段。输入：

{"key1": 123456, "key2": "abcd"}
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_parse_json_native

    SourceKey: content

  - Type: processor_drop

    DropKeys: 

      - key1

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-json content

      | project-away content

      | project-away key1

flushers:

  - Type: flusher_stdout

    OnlyStdout: true输出：
{    "key2": "abcd",
    "__time__": "1713245944"
}


Json 解析+重命名字段

解析 json 并重命名解析后的字段。输入：

{"key1": 123456, "key2": "abcd"}
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_parse_json_native

    SourceKey: content

  - Type: processor_rename

    SourceKeys:

      - key1

    DestKeys:

      - new_key1

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-json content

      | project-away content

      | project-rename new_key1=key1

flushers:

  - Type: flusher_stdout

    OnlyStdout: true输出：
{

    "new_key1": "123456",

    "key2": "abcd",

    "__time__": "1713249130"

}


Json 解析+过滤日志

解析 json 并根据字段条件过滤日志。输入：

{"ip": "10.**.**.**", "method": "POST", "browser": "aliyun-sdk-java"}
{"ip": "10.**.**.**", "method": "POST", "browser": "chrome"}
{"ip": "192.168.**.**", "method": "POST", "browser": "aliyun-sls-ilogtail"}
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_parse_json_native

    SourceKey: content

  - Type: processor_filter_regex

    Include:

      ip: "10\\..*"

      method: POST

    Exclude:

      browser: "aliyun.*"

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-json content

      | project-away content

      | where regexp_like(ip, '10\..*') and regexp_like(method, 'POST') and not regexp_like(browser, 'aliyun.*')

flushers:

  - Type: flusher_stdout

    OnlyStdout: true输出：
{

    "ip": "10.**.**.**",

    "method": "POST",

    "browser": "chrome",

    "__time__": "1713246645"

}


Json 解析+字段值映射处理

解析 json 并根据字段值的不同，映射为不同的值。输入：

{"_ip_":"192.168.0.1","Index":"900000003"}
{"_ip_":"255.255.255.255","Index":"3"}
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_parse_json_native

    SourceKey: content

  - Type: processor_dict_map

    MapDict:

      "127.0.0.1": "LocalHost-LocalHost"

      "192.168.0.1": "default login"

    SourceKey: "_ip_"

    DestKey: "_processed_ip_"

    Mode: "overwrite"

    HandleMissing": true

    Missing: "Not Detected"

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-json content

      | project-away content

      | extend _processed_ip_= 

      CASE 

        WHEN _ip_ = '127.0.0.1' THEN 'LocalHost-LocalHost' 

        WHEN _ip_ = '192.168.0.1' THEN 'default login' 

        ELSE 'Not Detected'

      END

flushers:

  - Type: flusher_stdout

    OnlyStdout: true输出：
{

    "_ip_": "192.168.0.1",

    "Index": "900000003",

    "_processed_ip_": "default login",

    "__time__": "1713259557"

}


字符串替换

替换日志中的指定字符串。输入：

hello,how old are you? nice to meet you
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_string_replace

    SourceKey: content

    Method: const

    Match: "how old are you?"

    ReplaceString: ""

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | extend content=replace(content, 'how old are you?', '')

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
输出：{    "content": "hello, nice to meet you",

    "__time__": "1713260499"

}


数据编码与解码

Base64

对日志进行 Base64 加密。输入：

this is a test log
原有插件：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_base64_encoding

    SourceKey: content

    NewKey: content1

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | extend content1=to_base64(cast(content as varbinary))

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
输出：{    "content": "this is a test log",

    "content1": "dGhpcyBpcyBhIHRlc3QgbG9n",

    "__time__": "1713318724"

}

MD5

对日志进行 MD5 加密。输入：

hello,how old are you? nice to meet you
原有插件：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_string_replace

    SourceKey: content

    Method: const

    Match: "how old are you?"

    ReplaceString: ""

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
SPL：enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | extend content1=lower(to_hex(md5(cast(content as varbinary))))

flushers:

  - Type: flusher_stdout

    OnlyStdout: true输出：
{

    "content": "this is a test log",

    "content1": "4f3c93e010f366eca78e00dc1ed08984",

    "__time__": "1713319673"

}

新增能力项




Cloud Native


数学计算

输入：4。SPL：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | extend val = cast(content as double)

      | extend power_test = power(val, 2)

      | extend round_test = round(val)

      | extend sqrt_test = sqrt(val)

flushers:

  - Type: flusher_stdout

    OnlyStdout: true输出：
{

    "content": "4",

    "power_test": 16.0,

    "round_test": 4.0,

    "sqrt_test": 2.0,

    "val": 4.0,

    "__time__": "1713319673"

}


URL 计算

URL 编码解码

输入：

https://homenew.console.aliyun.com/home/dashboard/ProductAndService

SPL：

enable: true
inputs:
  - Type: input_file
    FilePaths:
      - /workspaces/ilogtail/debug/simple.log
processors:
  - Type: processor_spl
    Script: |
      *
      | extend encoded = url_encode(content)
      | extend decoded = url_decode(encoded)
flushers:
  - Type: flusher_stdout
    OnlyStdout: true

输出：

{

    "content": "https://homenew.console.aliyun.com/home/dashboard/ProductAndService",

    "decoded": "https://homenew.console.aliyun.com/home/dashboard/ProductAndService",

    "encoded": "https%3A%2F%2Fhomenew.console.aliyun.com%2Fhome%2Fdashboard%2FProductAndService",

    "__time__": "1713319673"

}

URL 提取

输入：

https://sls.console.aliyun.com:443/lognext/project/dashboard-all/logsearch/nginx-demo?accounttraceid=d6241a173f88471c91d3405cda010ff5ghdw

SPL：

enable: true
inputs:
  - Type: input_file
    FilePaths:
      - /workspaces/ilogtail/debug/simple.log
processors:
  - Type: processor_spl
    Script: |
      *
      | extend host = url_extract_host(content)
      | extend query = url_extract_query(content)
      | extend path = url_extract_path(content) 
      | extend protocol = url_extract_protocol(content) 
      | extend port = url_extract_port(content) 
      | extend param = url_extract_parameter(content, 'accounttraceid')
flushers:
  - Type: flusher_stdout
    OnlyStdout: true

输出：

{

    "content": "https://sls.console.aliyun.com:443/lognext/project/dashboard-all/logsearch/nginx-demo?accounttraceid=d6241a173f88471c91d3405cda010ff5ghdw",

    "host": "sls.console.aliyun.com",

    "param": "d6241a173f88471c91d3405cda010ff5ghdw",

    "path": "/lognext/project/dashboard-all/logsearch/nginx-demo",

    "port": "443",

    "protocol": "https",

    "query": "accounttraceid=d6241a173f88471c91d3405cda010ff5ghdw",

    "__time__": "1713319673"

}


比较&逻辑运算符

输入：
{"num1": 199, "num2": 10, "num3": 9}
SPL：
enable: true

inputs:

  - Type: input_file

    FilePaths:

      - /workspaces/ilogtail/debug/simple.log

processors:

  - Type: processor_spl

    Script: |

      *

      | parse-json content

      | extend compare_result = cast(num1 as double) > cast(num2 as double) AND cast(num2 as double) > cast(num3 as double)

flushers:

  - Type: flusher_stdout

    OnlyStdout: true
输出：{    "compare_result": "true",

    "content": "{\"num1\": 199, \"num2\": 10, \"num3\": 9}",

    "num1": "199",

    "num2": "10",

    "num3": "9",

    "__time__": "1713319673"

}


其他

更多能力请参考：https://help.aliyun.com/zh/sls/user-guide/function-overview

欢迎大家补充更多 iLogtail SPL 实践案例！

相关推荐

阿里云国际站ECS:阿里云ECS如何提高网站的访问速度?

TG：@yunlaoda360引言：速度即体验，速度即业务在当今数字化的世界中，网站的访问速度已成为决定用户体验、用户留存乃至业务转化率的关键因素。页面加载每延迟一秒，都可能导致用户流失和收入损失。对...

高流量大并发Linux TCP性能调优_linux 高并发网络编程

其实主要是手里面的跑openvpn服务器。因为并没有明文禁p2p（哎……想想那么多流量好像不跑点p2p也跑不完），所以造成有的时候如果有比较多人跑BT的话，会造成VPN速度急剧下降。本文所面对的情况为...

性能测试100集(12)性能指标资源使用率

在性能测试中，资源使用率是评估系统硬件效率的关键指标，主要包括以下四类：#性能测试##性能压测策略##软件测试#1.CPU使用率定义：CPU处理任务的时间占比，计算公式为1-空闲时间/总...

Linux 服务器常见的性能调优_linux高性能服务端编程

一、Linux服务器性能调优第一步——先搞懂“看什么”很多人刚接触Linux性能调优时，总想着直接改配置，其实第一步该是“看清楚问题”。就像医生看病要先听诊，调优前得先知道服务器“哪里...

Nginx性能优化实战:手把手教你提升10倍性能!

关注△mikechen△，十余年BAT架构经验倾囊相授！Nginx是大型架构而核心，下面我重点详解Nginx性能@mikechen文章来源：mikechen.cc1.worker_processe...

高并发场景下，Spring Cloud Gateway如何抗住百万QPS?

关注△mikechen△，十余年BAT架构经验倾囊相授！大家好，我是mikechen。高并发场景下网关作为流量的入口非常重要，下面我重点详解SpringCloudGateway如何抗住百万性能@m...

Kubernetes 高并发处理实战(可落地案例 + 源码)

目标场景：对外提供HTTPAPI的微服务在短时间内收到大量请求（例如每秒数千至数万RPS），要求系统可弹性扩容、限流降级、缓存减压、稳定运行并能自动恢复。总体思路（多层防护）：边缘层：云LB...

高并发场景下，Nginx如何扛住千万级请求?

Nginx是大型架构的必备中间件，下面我重点详解Nginx如何实现高并发@mikechen文章来源：mikechen.cc事件驱动模型Nginx采用事件驱动模型，这是Nginx高并发性能的基石。传统...

Spring Boot+Vue全栈开发实战，中文版高清PDF资源

SpringBoot+Vue全栈开发实战，中文高清PDF资源，需要的可以私我：）SpringBoot致力于简化开发配置并为企业级开发提供一系列非业务性功能，而Vue则采用数据驱动视图的方式将程序...

Docker-基础操作_docker基础实战教程二

一、镜像1、从仓库获取镜像搜索镜像：dockersearchimage_name搜索结果过滤：是否官方:dockersearch--filter="is-offical=true...

你有空吗?跟我一起搭个服务器好不好?

来人人都是产品经理【起点学院】，BAT实战派产品总监手把手系统带你学产品、学运营。昨天闲的没事的时候，随手翻了翻写过的文章，发现一个很严重的问题。就是大多数时间我都在滔滔不绝的讲理论，却很少有涉及动手...

部署你自己的 SaaS_saas如何部署

部署你自己的VPNOpenVPN——功能齐全的开源VPN解决方案。（DigitalOcean教程）dockovpn.io—无状态OpenVPNdockerized服务器，不需要持久存储。...

Docker Compose_dockercompose安装

DockerCompose概述DockerCompose是一个用来定义和管理多容器应用的工具，通过一个docker-compose.yml文件，用YAML格式描述服务、网络、卷等内容，...

京东T7架构师推出的电子版SpringBoot，从构建小系统到架构大系统

前言：Java的各种开发框架发展了很多年，影响了一代又一代的程序员，现在无论是程序员，还是架构师，使用这些开发框架都面临着两方面的挑战。一方面是要快速开发出系统，这就要求使用的开发框架尽量简单，无论...

Kubernetes (k8s) 入门学习指南_k8s kubeproxy

Kubernetes(k8s)入门学习指南一、什么是Kubernetes？为什么需要它？Kubernetes(k8s)是一个开源的容器编排系统，用于自动化部署、扩展和管理容器化应用程序。它...

取消回复欢迎 你 发表评论:

一周热门
最近发表
标签列表
Copyright Your WebSite.Some Rights Reserved.