blob: 655b0d1ba161dea9be422979283b97b456ef0317 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
|
Stasher
Prototyping a logstash alternative
23 February 2017
Silvan Jegen
Computational Linguist, BioVariance GmbH
me@sillymon.ch
https://sillymon.ch
* Logstash
.image icon-logstash-bb.png
.caption logstash logo from the [[https://www.elastic.co/products/logstash][official logstash site]]
* What is it?
.image logstash-img1.png
* "Centralize, Transform & Stash"
- Input
- Filters
- Outputs
Examples
- Input:
- Filters:
- Outputs:
* How does it work?
Custom configuration language
input { stdin {} }
filter {
http {
"A" => "url:port"
}
}
output {
elasticsearch { hosts => ["localhost:9200"] }
stdout { codec => rubydebug }
}
* Modules
output {
stdout { codec => rubydebug }
}
* Some statistics
- Written in Ruby
- 10000 LOC in 999 files
* Stasher
Why?
- Apparently Logstash is very slow (see ElasticSearch Bumbles)
- I like Go
- Generality (error handling)
- Or not?
* Implementation
- Plugins?
- Generality and error handling
* Demo
* Todos
- Watch input directories
- Multiple modules for each main module
- Proper (configurable?) error handling
- DSL/declarative vs. Programming language balance?
* Considerations
- Plugins (Go 1.8!?)
- Better off with shell scripts?
Further Text, including invocations like:
.link http://foo label
.caption _Gopher_ by [[http://www.reneefrench.com][Renée French]]
Again, more text
|
