Page Menu
Home
Phabricator
Search
Configure Global Search
Log In
Paste
P9823
Masterwork From Distant Lands
Archived
Public
Actions
Authored by
ProdPasteBot
on Dec 5 2019, 1:24 PM.
Edit Paste
Activate Paste
View Raw File
Subscribe
Mute Notifications
Award Token
Flag For Later
Tags
None
Referenced Files
F31457817: raw.txt
Dec 5 2019, 1:24 PM
2019-12-05 13:24:44 (UTC+0)
Subscribers
None
--- contention:
cycles/second=2500025161
goroutine profile: total 51
16 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x6eb0ec 0x45b901
# 0x6eb0eb github.com/google/mtail/metrics.(*Metric).EmitLabelSets+0x5b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:179
13 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a008d 0x4a1987 0x50a15f 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a008c internal/poll.(*pollDesc).waitWrite+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:94
# 0x4a1986 internal/poll.(*FD).Write+0x236 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:264
# 0x50a15e net.(*netFD).Write+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:220
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
3 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a008d 0x4a1987 0x50a15f 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a008c internal/poll.(*pollDesc).waitWrite+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:94
# 0x4a1986 internal/poll.(*FD).Write+0x236 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:264
# 0x50a15e net.(*netFD).Write+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:220
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
2 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a001d 0x4a0e7d 0x509c9f 0x51adaa 0x6b6b18 0x47206e 0x472d4c 0x472f64 0x64ad20 0x64ab2b 0x6b150c 0x6b7dbf 0x6bbabc 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a001c internal/poll.(*pollDesc).waitRead+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:90
# 0x4a0e7c internal/poll.(*FD).Read+0x17c /usr/lib/go-1.10/src/internal/poll/fd_unix.go:157
# 0x509c9e net.(*netFD).Read+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:202
# 0x51ada9 net.(*conn).Read+0x69 /usr/lib/go-1.10/src/net/net.go:176
# 0x6b6b17 net/http.(*connReader).Read+0xf7 /usr/lib/go-1.10/src/net/http/server.go:764
# 0x47206d bufio.(*Reader).fill+0x11d /usr/lib/go-1.10/src/bufio/bufio.go:100
# 0x472d4b bufio.(*Reader).ReadSlice+0x2b /usr/lib/go-1.10/src/bufio/bufio.go:341
# 0x472f63 bufio.(*Reader).ReadLine+0x33 /usr/lib/go-1.10/src/bufio/bufio.go:370
# 0x64ad1f net/textproto.(*Reader).readLineSlice+0x6f /usr/lib/go-1.10/src/net/textproto/reader.go:55
# 0x64ab2a net/textproto.(*Reader).ReadLine+0x2a /usr/lib/go-1.10/src/net/textproto/reader.go:36
# 0x6b150b net/http.readRequest+0x8b /usr/lib/go-1.10/src/net/http/request.go:929
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
2 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x6f4d48 0x45b901
# 0x6f4d47 github.com/google/mtail/watcher.(*LogWatcher).run.func1+0x97 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:58
1 @ 0x411152 0x442e46 0x6e4a82 0x45b901
# 0x442e45 os/signal.signal_recv+0xa5 /usr/lib/go-1.10/src/runtime/sigqueue.go:139
# 0x6e4a81 os/signal.loop+0x21 /usr/lib/go-1.10/src/os/signal/signal_unix.go:22
1 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a001d 0x4a0e7d 0x509c9f 0x51adaa 0x6b666a 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a001c internal/poll.(*pollDesc).waitRead+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:90
# 0x4a0e7c internal/poll.(*FD).Read+0x17c /usr/lib/go-1.10/src/internal/poll/fd_unix.go:157
# 0x509c9e net.(*netFD).Read+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:202
# 0x51ada9 net.(*conn).Read+0x69 /usr/lib/go-1.10/src/net/net.go:176
# 0x6b6669 net/http.(*connReader).backgroundRead+0x59 /usr/lib/go-1.10/src/net/http/server.go:668
1 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a001d 0x4a2418 0x50a5b2 0x52472e 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a001c internal/poll.(*pollDesc).waitRead+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:90
# 0x4a2417 internal/poll.(*FD).Accept+0x1a7 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:372
# 0x50a5b1 net.(*netFD).accept+0x41 /usr/lib/go-1.10/src/net/fd_unix.go:238
# 0x52472d net.(*TCPListener).accept+0x2d /usr/lib/go-1.10/src/net/tcpsock_posix.go:136
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x6f4965 0x6f4b8a 0x45b901
# 0x6f4964 github.com/google/mtail/watcher.(*LogWatcher).sendEvent+0x84 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:50
# 0x6f4b89 github.com/google/mtail/watcher.(*LogWatcher).run+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:69
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x717db0 0x71786a 0x719cc5 0x45b901
# 0x717daf github.com/google/mtail/tailer.(*Tailer).read+0x21f /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x7356aa 0x45b901
# 0x7356a9 github.com/google/mtail/vm.(*Loader).processLines+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:360
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x4f05bb 0x45b901
# 0x4f05ba github.com/golang/glog.(*loggingT).flushDaemon+0x8a /build/mtail-3.0.0~rc5/build/src/github.com/golang/glog/glog.go:882
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x6f4a3a 0x45b901
# 0x6f4a39 github.com/google/mtail/watcher.(*LogWatcher).run+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:63
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x73541f 0x45b901
# 0x73541e github.com/google/mtail/vm.(*Loader).processEvents+0x6e /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:338
1 @ 0x42e60a 0x42e6be 0x43eda4 0x43e9c9 0x4649ae 0x6ea778 0x74658d 0x74b533 0x74b6a5 0x45b901
# 0x43e9c8 sync.runtime_Semacquire+0x38 /usr/lib/go-1.10/src/runtime/sema.go:56
# 0x4649ad sync.(*RWMutex).Lock+0x6d /usr/lib/go-1.10/src/sync/rwmutex.go:98
# 0x6ea777 github.com/google/mtail/metrics.(*Metric).GetDatum+0x67 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:123
# 0x74658c github.com/google/mtail/vm.(*VM).execute+0x24c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:644
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
1 @ 0x42e60a 0x43e120 0x4584d4 0x45b901
# 0x42e609 runtime.gopark+0x119 /usr/lib/go-1.10/src/runtime/proc.go:291
# 0x43e11f runtime.selectgo+0xe4f /usr/lib/go-1.10/src/runtime/select.go:392
# 0x4584d3 runtime.ensureSigM.func1+0x1f3 /usr/lib/go-1.10/src/runtime/signal_unix.go:549
1 @ 0x42e60a 0x43e120 0x6f33d0 0x45b901
# 0x6f33cf github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x5af /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:284
1 @ 0x42e60a 0x43e120 0x753fcd 0x753cda 0x75426c 0x7635c7 0x42e1b2 0x45b901
# 0x753fcc github.com/google/mtail/mtail.(*MtailServer).WaitForShutdown+0x14c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:239
# 0x753cd9 github.com/google/mtail/mtail.(*MtailServer).Serve+0x1f9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:222
# 0x75426b github.com/google/mtail/mtail.(*MtailServer).Run+0x16b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:290
# 0x7635c6 main.main+0x516 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/main.go:144
# 0x42e1b1 runtime.main+0x211 /usr/lib/go-1.10/src/runtime/proc.go:198
1 @ 0x48aff5 0x6f1cfa 0x6f3d81 0x6f2fb4 0x45b901
# 0x48aff4 syscall.Syscall6+0x4 /usr/lib/go-1.10/src/syscall/asm_linux_amd64.s:44
# 0x6f1cf9 golang.org/x/sys/unix.EpollWait+0x79 /build/mtail-3.0.0~rc5/build/src/golang.org/x/sys/unix/zsyscall_linux_amd64.go:1555
# 0x6f3d80 github.com/fsnotify/fsnotify.(*fdPoller).wait+0x90 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify_poller.go:86
# 0x6f2fb3 github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x193 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:192
1 @ 0x75a2a8 0x75a0b0 0x756bf4 0x7623bd 0x762741 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x75a2a7 runtime/pprof.writeRuntimeProfile+0x97 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:679
# 0x75a0af runtime/pprof.writeGoroutine+0x9f /usr/lib/go-1.10/src/runtime/pprof/pprof.go:641
# 0x756bf3 runtime/pprof.(*Profile).WriteTo+0x3e3 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:310
# 0x7623bc net/http/pprof.handler.ServeHTTP+0x20c /usr/lib/go-1.10/src/net/http/pprof/pprof.go:243
# 0x762740 net/http/pprof.Index+0x1d0 /usr/lib/go-1.10/src/net/http/pprof/pprof.go:254
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
goroutine profile: total 53
16 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x6eb0ec 0x45b901
# 0x6eb0eb github.com/google/mtail/metrics.(*Metric).EmitLabelSets+0x5b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:179
13 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a008d 0x4a1987 0x50a15f 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a008c internal/poll.(*pollDesc).waitWrite+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:94
# 0x4a1986 internal/poll.(*FD).Write+0x236 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:264
# 0x50a15e net.(*netFD).Write+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:220
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
3 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a008d 0x4a1987 0x50a15f 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a008c internal/poll.(*pollDesc).waitWrite+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:94
# 0x4a1986 internal/poll.(*FD).Write+0x236 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:264
# 0x50a15e net.(*netFD).Write+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:220
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
3 @ 0x42e60a 0x42e6be 0x43eda4 0x43e9c9 0x464889 0x6eec29 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x43e9c8 sync.runtime_Semacquire+0x38 /usr/lib/go-1.10/src/runtime/sema.go:56
# 0x464888 sync.(*RWMutex).RLock+0x48 /usr/lib/go-1.10/src/sync/rwmutex.go:50
# 0x6eec28 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x408 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:39
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
2 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x6f4d48 0x45b901
# 0x6f4d47 github.com/google/mtail/watcher.(*LogWatcher).run.func1+0x97 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:58
1 @ 0x411152 0x442e46 0x6e4a82 0x45b901
# 0x442e45 os/signal.signal_recv+0xa5 /usr/lib/go-1.10/src/runtime/sigqueue.go:139
# 0x6e4a81 os/signal.loop+0x21 /usr/lib/go-1.10/src/os/signal/signal_unix.go:22
1 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a001d 0x4a0e7d 0x509c9f 0x51adaa 0x6b666a 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a001c internal/poll.(*pollDesc).waitRead+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:90
# 0x4a0e7c internal/poll.(*FD).Read+0x17c /usr/lib/go-1.10/src/internal/poll/fd_unix.go:157
# 0x509c9e net.(*netFD).Read+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:202
# 0x51ada9 net.(*conn).Read+0x69 /usr/lib/go-1.10/src/net/net.go:176
# 0x6b6669 net/http.(*connReader).backgroundRead+0x59 /usr/lib/go-1.10/src/net/http/server.go:668
1 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a001d 0x4a2418 0x50a5b2 0x52472e 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a001c internal/poll.(*pollDesc).waitRead+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:90
# 0x4a2417 internal/poll.(*FD).Accept+0x1a7 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:372
# 0x50a5b1 net.(*netFD).accept+0x41 /usr/lib/go-1.10/src/net/fd_unix.go:238
# 0x52472d net.(*TCPListener).accept+0x2d /usr/lib/go-1.10/src/net/tcpsock_posix.go:136
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x6f4965 0x6f4b8a 0x45b901
# 0x6f4964 github.com/google/mtail/watcher.(*LogWatcher).sendEvent+0x84 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:50
# 0x6f4b89 github.com/google/mtail/watcher.(*LogWatcher).run+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:69
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x717db0 0x71786a 0x719cc5 0x45b901
# 0x717daf github.com/google/mtail/tailer.(*Tailer).read+0x21f /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x7356aa 0x45b901
# 0x7356a9 github.com/google/mtail/vm.(*Loader).processLines+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:360
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x4f05bb 0x45b901
# 0x4f05ba github.com/golang/glog.(*loggingT).flushDaemon+0x8a /build/mtail-3.0.0~rc5/build/src/github.com/golang/glog/glog.go:882
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x6f4a3a 0x45b901
# 0x6f4a39 github.com/google/mtail/watcher.(*LogWatcher).run+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:63
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x73541f 0x45b901
# 0x73541e github.com/google/mtail/vm.(*Loader).processEvents+0x6e /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:338
1 @ 0x42e60a 0x42e6be 0x43eda4 0x43e9c9 0x4649ae 0x6ea778 0x74658d 0x74b533 0x74b6a5 0x45b901
# 0x43e9c8 sync.runtime_Semacquire+0x38 /usr/lib/go-1.10/src/runtime/sema.go:56
# 0x4649ad sync.(*RWMutex).Lock+0x6d /usr/lib/go-1.10/src/sync/rwmutex.go:98
# 0x6ea777 github.com/google/mtail/metrics.(*Metric).GetDatum+0x67 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:123
# 0x74658c github.com/google/mtail/vm.(*VM).execute+0x24c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:644
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
1 @ 0x42e60a 0x43e120 0x4584d4 0x45b901
# 0x42e609 runtime.gopark+0x119 /usr/lib/go-1.10/src/runtime/proc.go:291
# 0x43e11f runtime.selectgo+0xe4f /usr/lib/go-1.10/src/runtime/select.go:392
# 0x4584d3 runtime.ensureSigM.func1+0x1f3 /usr/lib/go-1.10/src/runtime/signal_unix.go:549
1 @ 0x42e60a 0x43e120 0x6f33d0 0x45b901
# 0x6f33cf github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x5af /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:284
1 @ 0x42e60a 0x43e120 0x753fcd 0x753cda 0x75426c 0x7635c7 0x42e1b2 0x45b901
# 0x753fcc github.com/google/mtail/mtail.(*MtailServer).WaitForShutdown+0x14c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:239
# 0x753cd9 github.com/google/mtail/mtail.(*MtailServer).Serve+0x1f9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:222
# 0x75426b github.com/google/mtail/mtail.(*MtailServer).Run+0x16b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:290
# 0x7635c6 main.main+0x516 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/main.go:144
# 0x42e1b1 runtime.main+0x211 /usr/lib/go-1.10/src/runtime/proc.go:198
1 @ 0x48af75 0x488c6f 0x486d09 0x4a0e18 0x509c9f 0x51adaa 0x6b666a 0x45b901
# 0x48af74 syscall.Syscall+0x4 /usr/lib/go-1.10/src/syscall/asm_linux_amd64.s:18
# 0x488c6e syscall.read+0x5e /usr/lib/go-1.10/src/syscall/zsyscall_linux_amd64.go:749
# 0x486d08 syscall.Read+0x48 /usr/lib/go-1.10/src/syscall/syscall_unix.go:162
# 0x4a0e17 internal/poll.(*FD).Read+0x117 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:153
# 0x509c9e net.(*netFD).Read+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:202
# 0x51ada9 net.(*conn).Read+0x69 /usr/lib/go-1.10/src/net/net.go:176
# 0x6b6669 net/http.(*connReader).backgroundRead+0x59 /usr/lib/go-1.10/src/net/http/server.go:668
1 @ 0x48aff5 0x6f1cfa 0x6f3d81 0x6f2fb4 0x45b901
# 0x48aff4 syscall.Syscall6+0x4 /usr/lib/go-1.10/src/syscall/asm_linux_amd64.s:44
# 0x6f1cf9 golang.org/x/sys/unix.EpollWait+0x79 /build/mtail-3.0.0~rc5/build/src/golang.org/x/sys/unix/zsyscall_linux_amd64.go:1555
# 0x6f3d80 github.com/fsnotify/fsnotify.(*fdPoller).wait+0x90 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify_poller.go:86
# 0x6f2fb3 github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x193 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:192
1 @ 0x75a2a8 0x75a0b0 0x756bf4 0x7623bd 0x762741 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x75a2a7 runtime/pprof.writeRuntimeProfile+0x97 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:679
# 0x75a0af runtime/pprof.writeGoroutine+0x9f /usr/lib/go-1.10/src/runtime/pprof/pprof.go:641
# 0x756bf3 runtime/pprof.(*Profile).WriteTo+0x3e3 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:310
# 0x7623bc net/http/pprof.handler.ServeHTTP+0x20c /usr/lib/go-1.10/src/net/http/pprof/pprof.go:243
# 0x762740 net/http/pprof.Index+0x1d0 /usr/lib/go-1.10/src/net/http/pprof/pprof.go:254
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
goroutine profile: total 53
16 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x6eb0ec 0x45b901
# 0x6eb0eb github.com/google/mtail/metrics.(*Metric).EmitLabelSets+0x5b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:179
13 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a008d 0x4a1987 0x50a15f 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a008c internal/poll.(*pollDesc).waitWrite+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:94
# 0x4a1986 internal/poll.(*FD).Write+0x236 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:264
# 0x50a15e net.(*netFD).Write+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:220
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
3 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a008d 0x4a1987 0x50a15f 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a008c internal/poll.(*pollDesc).waitWrite+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:94
# 0x4a1986 internal/poll.(*FD).Write+0x236 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:264
# 0x50a15e net.(*netFD).Write+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:220
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
3 @ 0x42e60a 0x42e6be 0x43eda4 0x43e9c9 0x464889 0x6eec29 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x43e9c8 sync.runtime_Semacquire+0x38 /usr/lib/go-1.10/src/runtime/sema.go:56
# 0x464888 sync.(*RWMutex).RLock+0x48 /usr/lib/go-1.10/src/sync/rwmutex.go:50
# 0x6eec28 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x408 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:39
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
2 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a001d 0x4a0e7d 0x509c9f 0x51adaa 0x6b666a 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a001c internal/poll.(*pollDesc).waitRead+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:90
# 0x4a0e7c internal/poll.(*FD).Read+0x17c /usr/lib/go-1.10/src/internal/poll/fd_unix.go:157
# 0x509c9e net.(*netFD).Read+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:202
# 0x51ada9 net.(*conn).Read+0x69 /usr/lib/go-1.10/src/net/net.go:176
# 0x6b6669 net/http.(*connReader).backgroundRead+0x59 /usr/lib/go-1.10/src/net/http/server.go:668
2 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x6f4d48 0x45b901
# 0x6f4d47 github.com/google/mtail/watcher.(*LogWatcher).run.func1+0x97 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:58
1 @ 0x411152 0x442e46 0x6e4a82 0x45b901
# 0x442e45 os/signal.signal_recv+0xa5 /usr/lib/go-1.10/src/runtime/sigqueue.go:139
# 0x6e4a81 os/signal.loop+0x21 /usr/lib/go-1.10/src/os/signal/signal_unix.go:22
1 @ 0x42e60a 0x42992a 0x428fa7 0x49ff9b 0x4a001d 0x4a2418 0x50a5b2 0x52472e 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x428fa6 internal/poll.runtime_pollWait+0x56 /usr/lib/go-1.10/src/runtime/netpoll.go:173
# 0x49ff9a internal/poll.(*pollDesc).wait+0x9a /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:85
# 0x4a001c internal/poll.(*pollDesc).waitRead+0x3c /usr/lib/go-1.10/src/internal/poll/fd_poll_runtime.go:90
# 0x4a2417 internal/poll.(*FD).Accept+0x1a7 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:372
# 0x50a5b1 net.(*netFD).accept+0x41 /usr/lib/go-1.10/src/net/fd_unix.go:238
# 0x52472d net.(*TCPListener).accept+0x2d /usr/lib/go-1.10/src/net/tcpsock_posix.go:136
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x6f4965 0x6f4b8a 0x45b901
# 0x6f4964 github.com/google/mtail/watcher.(*LogWatcher).sendEvent+0x84 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:50
# 0x6f4b89 github.com/google/mtail/watcher.(*LogWatcher).run+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:69
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x717db0 0x71786a 0x719cc5 0x45b901
# 0x717daf github.com/google/mtail/tailer.(*Tailer).read+0x21f /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1 @ 0x42e60a 0x42e6be 0x40542b 0x4051c5 0x7356aa 0x45b901
# 0x7356a9 github.com/google/mtail/vm.(*Loader).processLines+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:360
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x4f05bb 0x45b901
# 0x4f05ba github.com/golang/glog.(*loggingT).flushDaemon+0x8a /build/mtail-3.0.0~rc5/build/src/github.com/golang/glog/glog.go:882
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x6f4a3a 0x45b901
# 0x6f4a39 github.com/google/mtail/watcher.(*LogWatcher).run+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:63
1 @ 0x42e60a 0x42e6be 0x406082 0x405d7b 0x73541f 0x45b901
# 0x73541e github.com/google/mtail/vm.(*Loader).processEvents+0x6e /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:338
1 @ 0x42e60a 0x42e6be 0x43eda4 0x43e9c9 0x4649ae 0x6ea778 0x74658d 0x74b533 0x74b6a5 0x45b901
# 0x43e9c8 sync.runtime_Semacquire+0x38 /usr/lib/go-1.10/src/runtime/sema.go:56
# 0x4649ad sync.(*RWMutex).Lock+0x6d /usr/lib/go-1.10/src/sync/rwmutex.go:98
# 0x6ea777 github.com/google/mtail/metrics.(*Metric).GetDatum+0x67 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:123
# 0x74658c github.com/google/mtail/vm.(*VM).execute+0x24c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:644
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
1 @ 0x42e60a 0x43e120 0x4584d4 0x45b901
# 0x42e609 runtime.gopark+0x119 /usr/lib/go-1.10/src/runtime/proc.go:291
# 0x43e11f runtime.selectgo+0xe4f /usr/lib/go-1.10/src/runtime/select.go:392
# 0x4584d3 runtime.ensureSigM.func1+0x1f3 /usr/lib/go-1.10/src/runtime/signal_unix.go:549
1 @ 0x42e60a 0x43e120 0x6f33d0 0x45b901
# 0x6f33cf github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x5af /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:284
1 @ 0x42e60a 0x43e120 0x753fcd 0x753cda 0x75426c 0x7635c7 0x42e1b2 0x45b901
# 0x753fcc github.com/google/mtail/mtail.(*MtailServer).WaitForShutdown+0x14c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:239
# 0x753cd9 github.com/google/mtail/mtail.(*MtailServer).Serve+0x1f9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:222
# 0x75426b github.com/google/mtail/mtail.(*MtailServer).Run+0x16b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:290
# 0x7635c6 main.main+0x516 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/main.go:144
# 0x42e1b1 runtime.main+0x211 /usr/lib/go-1.10/src/runtime/proc.go:198
1 @ 0x48aff5 0x6f1cfa 0x6f3d81 0x6f2fb4 0x45b901
# 0x48aff4 syscall.Syscall6+0x4 /usr/lib/go-1.10/src/syscall/asm_linux_amd64.s:44
# 0x6f1cf9 golang.org/x/sys/unix.EpollWait+0x79 /build/mtail-3.0.0~rc5/build/src/golang.org/x/sys/unix/zsyscall_linux_amd64.go:1555
# 0x6f3d80 github.com/fsnotify/fsnotify.(*fdPoller).wait+0x90 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify_poller.go:86
# 0x6f2fb3 github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x193 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:192
1 @ 0x75a2a8 0x75a0b0 0x756bf4 0x7623bd 0x762741 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x75a2a7 runtime/pprof.writeRuntimeProfile+0x97 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:679
# 0x75a0af runtime/pprof.writeGoroutine+0x9f /usr/lib/go-1.10/src/runtime/pprof/pprof.go:641
# 0x756bf3 runtime/pprof.(*Profile).WriteTo+0x3e3 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:310
# 0x7623bc net/http/pprof.handler.ServeHTTP+0x20c /usr/lib/go-1.10/src/net/http/pprof/pprof.go:243
# 0x762740 net/http/pprof.Index+0x1d0 /usr/lib/go-1.10/src/net/http/pprof/pprof.go:254
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
heap profile: 3773: 376411296 [7586187: 17260373536] @ heap/1048576
1: 374341632 [1: 374341632] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
449: 215520 [20365: 9775200] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
480: 215040 [23955: 10731840] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
313: 180288 [15420: 8881920] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
316: 161792 [13836: 7084032] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
177: 158592 [5065: 4538240] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
303: 126048 [23784: 9894144] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
149: 114432 [4526: 3475968] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 98304 [1: 98304] @ 0x40aa12 0x409083 0x562aad 0x58dd2d 0x7545c2 0x7639c8 0x42e16a 0x45b901
# 0x562aac html.init+0x6c /usr/lib/go-1.10/src/html/entity.go:16
# 0x42e169 runtime.main+0x1c9 /usr/lib/go-1.10/src/runtime/proc.go:186
328: 94464 [16225: 4672800] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
134: 94336 [5678: 3997312] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
146: 93440 [7888: 5048320] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
273: 87360 [19308: 6178560] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
211: 81024 [17104: 6567936] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
74: 75776 [2307: 2362368] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
142: 49984 [13026: 4585152] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
35: 40320 [1227: 1413504] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
16: 28672 [765: 1370880] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
17: 21760 [626: 801280] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
79: 20224 [3256: 833536] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
6: 13824 [265: 610560] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
6: 12288 [487: 997376] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
7: 10752 [378: 580608] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
3: 9216 [312: 958464] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
6: 8448 [315: 443520] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
35: 8400 [1888: 453120] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 8192 [68: 557056] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 6144 [84: 516096] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
26: 5824 [2047: 458528] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 5376 [88: 473088] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 4864 [125: 608000] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 4096 [160: 655360] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
21: 4032 [771: 148032] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 3200 [51: 163200] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 2688 [302: 811776] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 2048 [1: 2048] @ 0x664a71 0x664995 0x665dfb 0x6d6925 0x7545cc 0x7639c8 0x42e16a 0x45b901
# 0x664a70 vendor/golang_org/x/net/http2/hpack.newInternalNode+0xb0 /usr/lib/go-1.10/src/vendor/golang_org/x/net/http2/hpack/huffman.go:117
# 0x664a70 vendor/golang_org/x/net/http2/hpack.addDecoderNode+0xb0 /usr/lib/go-1.10/src/vendor/golang_org/x/net/http2/hpack/huffman.go:137
# 0x664994 vendor/golang_org/x/net/http2/hpack.init.0+0x74 /usr/lib/go-1.10/src/vendor/golang_org/x/net/http2/hpack/huffman.go:127
# 0x42e169 runtime.main+0x1c9 /usr/lib/go-1.10/src/runtime/proc.go:186
6: 1248 [487: 101296] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
1: 1024 [1: 1024] @ 0x431968 0x4320a9 0x430ef0 0x456526 0x458e39 0x430f80
# 0x431967 runtime.allocm+0x127 /usr/lib/go-1.10/src/runtime/proc.go:1514
# 0x4320a8 runtime.newm+0x38 /usr/lib/go-1.10/src/runtime/proc.go:1830
# 0x430eef runtime.startTheWorldWithSema+0x1cf /usr/lib/go-1.10/src/runtime/proc.go:1155
# 0x456525 runtime.gcMarkTermination.func3+0x25 /usr/lib/go-1.10/src/runtime/mgc.go:1647
# 0x458e38 runtime.systemstack+0x78 /usr/lib/go-1.10/src/runtime/asm_amd64.s:409
# 0x430f80 runtime.mstart+0x0 /usr/lib/go-1.10/src/runtime/proc.go:1175
1: 384 [1: 384] @ 0x435aa1 0x435fbd 0x4580b6 0x458e39 0x430f80
# 0x435aa0 runtime.malg+0x30 /usr/lib/go-1.10/src/runtime/proc.go:3221
# 0x435fbc runtime.newproc1+0x42c /usr/lib/go-1.10/src/runtime/proc.go:3273
# 0x4580b5 runtime.newproc.func1+0x45 /usr/lib/go-1.10/src/runtime/proc.go:3244
# 0x458e38 runtime.systemstack+0x78 /usr/lib/go-1.10/src/runtime/asm_amd64.s:409
# 0x430f80 runtime.mstart+0x0 /usr/lib/go-1.10/src/runtime/proc.go:1175
2: 192 [13: 1248] @ 0x42e9b2 0x4052fd 0x4051c5 0x6eb0ec 0x45b901
# 0x6eb0eb github.com/google/mtail/metrics.(*Metric).EmitLabelSets+0x5b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:179
1: 48 [1: 48] @ 0x6ea84f 0x74658d 0x74b533 0x74b6a5 0x45b901
# 0x6ea84e github.com/google/mtail/metrics.(*Metric).GetDatum+0x13e /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:134
# 0x74658c github.com/google/mtail/vm.(*VM).execute+0x24c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:644
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [2: 32768] @ 0x46e83d 0x46e1f1 0x46ea8c 0x46ebf5 0x717c8f 0x71786a 0x719cc5 0x45b901
# 0x46e83c bytes.makeSlice+0x6c /usr/lib/go-1.10/src/bytes/buffer.go:230
# 0x46e1f0 bytes.(*Buffer).grow+0x150 /usr/lib/go-1.10/src/bytes/buffer.go:144
# 0x46ea8b bytes.(*Buffer).WriteByte+0x8b /usr/lib/go-1.10/src/bytes/buffer.go:268
# 0x46ebf4 bytes.(*Buffer).WriteRune+0x134 /usr/lib/go-1.10/src/bytes/buffer.go:280
# 0x717c8e github.com/google/mtail/tailer.(*Tailer).read+0xfe /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:241
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [4: 64] @ 0x4c7677 0x4c82db 0x4cbadd 0x4cdfd7 0x4d10f7 0x4ca452 0x6b5423 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7676 fmt.(*buffer).Write+0x106 /usr/lib/go-1.10/src/fmt/print.go:78
# 0x4c7676 fmt.(*fmt).pad+0x106 /usr/lib/go-1.10/src/fmt/format.go:92
# 0x4c82da fmt.(*fmt).fmt_integer+0x1da /usr/lib/go-1.10/src/fmt/format.go:307
# 0x4cbadc fmt.(*pp).fmtInteger+0x2fc /usr/lib/go-1.10/src/fmt/print.go:375
# 0x4cdfd6 fmt.(*pp).printArg+0x836 /usr/lib/go-1.10/src/fmt/print.go:649
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca451 fmt.Fprintf+0x71 /usr/lib/go-1.10/src/fmt/print.go:188
# 0x6b5422 net/http.(*chunkWriter).Write+0x222 /usr/lib/go-1.10/src/net/http/server.go:366
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [38: 3648] @ 0x4f38c5 0x4f34c5 0x4f33c1 0x6b812b 0x6bbabc 0x45b901
# 0x4f38c4 context.(*cancelCtx).Done+0x94 /usr/lib/go-1.10/src/context/context.go:328
# 0x4f34c4 context.propagateCancel+0x34 /usr/lib/go-1.10/src/context/context.go:243
# 0x4f33c0 context.WithCancel+0x110 /usr/lib/go-1.10/src/context/context.go:232
# 0x6b812a net/http.(*conn).readRequest+0x4da /usr/lib/go-1.10/src/net/http/server.go:982
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [23: 1472] @ 0x485847 0x485b10 0x4a314f 0x4a2341 0x50a5b2 0x52472e 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x485846 syscall.anyToSockaddr+0x296 /usr/lib/go-1.10/src/syscall/syscall_linux.go:424
# 0x485b0f syscall.Accept4+0xbf /usr/lib/go-1.10/src/syscall/syscall_linux.go:461
# 0x4a314e internal/poll.accept+0x3e /usr/lib/go-1.10/src/internal/poll/sock_cloexec.go:17
# 0x4a2340 internal/poll.(*FD).Accept+0xd0 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:365
# 0x50a5b1 net.(*netFD).accept+0x41 /usr/lib/go-1.10/src/net/fd_unix.go:238
# 0x52472d net.(*TCPListener).accept+0x2d /usr/lib/go-1.10/src/net/tcpsock_posix.go:136
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
0: 0 [4: 64] @ 0x51de2b 0x510360 0x510646 0x521a3d 0x6bb640 0x45b901
# 0x51de2a net.uitoa+0xca /usr/lib/go-1.10/src/net/parse.go:204
# 0x51035f net.IP.String+0x3ff /usr/lib/go-1.10/src/net/ip.go:279
# 0x510645 net.ipEmptyString+0x55 /usr/lib/go-1.10/src/net/ip.go:340
# 0x521a3c net.(*TCPAddr).String+0x4c /usr/lib/go-1.10/src/net/tcpsock.go:32
# 0x6bb63f net/http.(*conn).serve+0x5f /usr/lib/go-1.10/src/net/http/server.go:1720
0: 0 [18: 864] @ 0x523c9e 0x50a865 0x52472e 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x523c9d net.sockaddrToTCP+0xcd /usr/lib/go-1.10/src/net/tcpsock_posix.go:21
# 0x50a864 net.(*netFD).accept+0x2f4 /usr/lib/go-1.10/src/net/fd_unix.go:255
# 0x52472d net.(*TCPListener).accept+0x2d /usr/lib/go-1.10/src/net/tcpsock_posix.go:136
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
0: 0 [26: 106496] @ 0x464403 0x464316 0x463e6d 0x6b7091 0x6bb1cf 0x6bb23b 0x6d59be 0x6bbe18 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x6b7090 net/http.putBufioReader+0xd0 /usr/lib/go-1.10/src/net/http/server.go:814
# 0x6bb1ce net/http.(*conn).finalFlush+0x9e /usr/lib/go-1.10/src/net/http/server.go:1603
# 0x6bb23a net/http.(*conn).close+0x2a /usr/lib/go-1.10/src/net/http/server.go:1618
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [50: 6400] @ 0x50a71f 0x52472e 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x50a71e net.newFD+0x1ae /usr/lib/go-1.10/src/net/fd_unix.go:40
# 0x50a71e net.(*netFD).accept+0x1ae /usr/lib/go-1.10/src/net/fd_unix.go:246
# 0x52472d net.(*TCPListener).accept+0x2d /usr/lib/go-1.10/src/net/tcpsock_posix.go:136
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
0: 0 [15: 480] @ 0x446b2f 0x44668a 0x4468e7 0x515e3f 0x521b5a 0x6bb640 0x45b901
# 0x515e3e net.JoinHostPort+0x11e /usr/lib/go-1.10/src/net/ipsock.go:232
# 0x521b59 net.(*TCPAddr).String+0x169 /usr/lib/go-1.10/src/net/tcpsock.go:36
# 0x6bb63f net/http.(*conn).serve+0x5f /usr/lib/go-1.10/src/net/http/server.go:1720
0: 0 [25: 1600] @ 0x485847 0x485ce3 0x50a817 0x52472e 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x485846 syscall.anyToSockaddr+0x296 /usr/lib/go-1.10/src/syscall/syscall_linux.go:424
# 0x485ce2 syscall.Getsockname+0xc2 /usr/lib/go-1.10/src/syscall/syscall_linux.go:475
# 0x50a816 net.(*netFD).accept+0x2a6 /usr/lib/go-1.10/src/net/fd_unix.go:254
# 0x52472d net.(*TCPListener).accept+0x2d /usr/lib/go-1.10/src/net/tcpsock_posix.go:136
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
0: 0 [36: 2880] @ 0x51b279 0x6bb252 0x6d59be 0x6bbe18 0x45b901
# 0x51b278 net.(*conn).Close+0x88 /usr/lib/go-1.10/src/net/net.go:202
# 0x6bb251 net/http.(*conn).close+0x41 /usr/lib/go-1.10/src/net/http/server.go:1619
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [17: 816] @ 0x4f44fa 0x6bb6d1 0x45b901
# 0x4f44f9 context.WithValue+0x79 /usr/lib/go-1.10/src/context/context.go:474
# 0x6bb6d0 net/http.(*conn).serve+0xf0 /usr/lib/go-1.10/src/net/http/server.go:1721
0: 0 [15: 1200] @ 0x51b07f 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x51b07e net.(*conn).Write+0xbe /usr/lib/go-1.10/src/net/net.go:190
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [7: 112] @ 0x446b2f 0x44668a 0x510477 0x510646 0x521a3d 0x6bb640 0x45b901
# 0x510476 net.IP.String+0x516 /usr/lib/go-1.10/src/net/ip.go:280
# 0x510645 net.ipEmptyString+0x55 /usr/lib/go-1.10/src/net/ip.go:340
# 0x521a3c net.(*TCPAddr).String+0x4c /usr/lib/go-1.10/src/net/tcpsock.go:32
# 0x6bb63f net/http.(*conn).serve+0x5f /usr/lib/go-1.10/src/net/http/server.go:1720
0: 0 [55: 5280] @ 0x6b6e7c 0x6bba08 0x45b901
# 0x6b6e7b bufio.NewReaderSize+0x1bb /usr/lib/go-1.10/src/bufio/bufio.go:55
# 0x6b6e7b bufio.NewReader+0x1bb /usr/lib/go-1.10/src/bufio/bufio.go:62
# 0x6b6e7b net/http.newBufioReader+0x1bb /usr/lib/go-1.10/src/net/http/server.go:809
# 0x6bba07 net/http.(*conn).serve+0x427 /usr/lib/go-1.10/src/net/http/server.go:1764
0: 0 [30: 1920] @ 0x6b643b 0x6b6a4f 0x47206e 0x472d4c 0x472f64 0x64ad20 0x64ab2b 0x6b150c 0x6b7dbf 0x6bbabc 0x45b901
# 0x6b643a sync.NewCond+0x6a /usr/lib/go-1.10/src/sync/cond.go:33
# 0x6b643a net/http.(*connReader).lock+0x6a /usr/lib/go-1.10/src/net/http/server.go:647
# 0x6b6a4e net/http.(*connReader).Read+0x2e /usr/lib/go-1.10/src/net/http/server.go:737
# 0x47206d bufio.(*Reader).fill+0x11d /usr/lib/go-1.10/src/bufio/bufio.go:100
# 0x472d4b bufio.(*Reader).ReadSlice+0x2b /usr/lib/go-1.10/src/bufio/bufio.go:341
# 0x472f63 bufio.(*Reader).ReadLine+0x33 /usr/lib/go-1.10/src/bufio/bufio.go:370
# 0x64ad1f net/textproto.(*Reader).readLineSlice+0x6f /usr/lib/go-1.10/src/net/textproto/reader.go:55
# 0x64ab2a net/textproto.(*Reader).ReadLine+0x2a /usr/lib/go-1.10/src/net/textproto/reader.go:36
# 0x6b150b net/http.readRequest+0x8b /usr/lib/go-1.10/src/net/http/request.go:929
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [20: 960] @ 0x6bb9cd 0x45b901
# 0x6bb9cc net/http.(*conn).serve+0x3ec /usr/lib/go-1.10/src/net/http/server.go:1763
0: 0 [13: 1040] @ 0x51b07f 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x51b07e net.(*conn).Write+0xbe /usr/lib/go-1.10/src/net/net.go:190
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [63: 10080] @ 0x6bfd2c 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x6bfd2b net/http.(*Server).newConn+0x1db /usr/lib/go-1.10/src/net/http/server.go:613
# 0x6bfd2b net/http.(*Server).Serve+0x1db /usr/lib/go-1.10/src/net/http/server.go:2793
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
0: 0 [349: 1429504] @ 0x464403 0x464316 0x46401f 0x6b6cff 0x6bba08 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6b6cfe net/http.newBufioReader+0x3e /usr/lib/go-1.10/src/net/http/server.go:802
# 0x6bba07 net/http.(*conn).serve+0x427 /usr/lib/go-1.10/src/net/http/server.go:1764
0: 0 [7: 224] @ 0x50a1c5 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x50a1c4 os.NewSyscallError+0xb4 /usr/lib/go-1.10/src/os/error.go:62
# 0x50a1c4 net.wrapSyscallError+0xb4 /usr/lib/go-1.10/src/net/error_posix.go:18
# 0x50a1c4 net.(*netFD).Write+0xb4 /usr/lib/go-1.10/src/net/fd_unix.go:222
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [30: 122880] @ 0x464403 0x464316 0x463e6d 0x6b73b4 0x6bb19a 0x6bb23b 0x6d59be 0x6bbe18 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x6b73b3 net/http.putBufioWriter+0xa3 /usr/lib/go-1.10/src/net/http/server.go:832
# 0x6bb199 net/http.(*conn).finalFlush+0x69 /usr/lib/go-1.10/src/net/http/server.go:1611
# 0x6bb23a net/http.(*conn).close+0x2a /usr/lib/go-1.10/src/net/http/server.go:1618
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [355: 1454080] @ 0x464403 0x464316 0x46401f 0x4c9f51 0x4ca406 0x6eedf6 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca405 fmt.Fprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:187
# 0x6eedf5 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x5d5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:43
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [32: 2048] @ 0x4f32ef 0x6bb967 0x45b901
# 0x4f32ee context.WithCancel+0x3e /usr/lib/go-1.10/src/context/context.go:231
# 0x6bb966 net/http.(*conn).serve+0x386 /usr/lib/go-1.10/src/net/http/server.go:1759
0: 0 [351: 1437696] @ 0x464403 0x464316 0x46401f 0x6b7225 0x6bba49 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6b7224 net/http.newBufioWriterSize+0x154 /usr/lib/go-1.10/src/net/http/server.go:820
# 0x6bba48 net/http.(*conn).serve+0x468 /usr/lib/go-1.10/src/net/http/server.go:1765
0: 0 [1507: 6172672] @ 0x6b716a 0x6bba49 0x45b901
# 0x6b7169 bufio.NewWriterSize+0x99 /usr/lib/go-1.10/src/bufio/bufio.go:544
# 0x6b7169 net/http.newBufioWriterSize+0x99 /usr/lib/go-1.10/src/net/http/server.go:826
# 0x6bba48 net/http.(*conn).serve+0x468 /usr/lib/go-1.10/src/net/http/server.go:1765
0: 0 [1565: 6410240] @ 0x6b6ea8 0x6bba08 0x45b901
# 0x6b6ea7 bufio.NewReaderSize+0x1e7 /usr/lib/go-1.10/src/bufio/bufio.go:56
# 0x6b6ea7 bufio.NewReader+0x1e7 /usr/lib/go-1.10/src/bufio/bufio.go:62
# 0x6b6ea7 net/http.newBufioReader+0x1e7 /usr/lib/go-1.10/src/net/http/server.go:809
# 0x6bba07 net/http.(*conn).serve+0x427 /usr/lib/go-1.10/src/net/http/server.go:1764
0: 0 [1: 16384] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [19: 257792] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [6: 86016] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [7: 68096] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [14: 152320] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [5: 320] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [52: 7488] @ 0x409d16 0x4f3573 0x4f33c1 0x6b812b 0x6bbabc 0x45b901
# 0x4f3572 context.propagateCancel+0xe2 /usr/lib/go-1.10/src/context/context.go:255
# 0x4f33c0 context.WithCancel+0x110 /usr/lib/go-1.10/src/context/context.go:232
# 0x6b812a net/http.(*conn).readRequest+0x4da /usr/lib/go-1.10/src/net/http/server.go:982
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [3: 144] @ 0x4c7677 0x4c8f1f 0x4cbf2c 0x4cdf29 0x4d10f7 0x4ca606 0x6ef039 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7676 fmt.(*buffer).Write+0x106 /usr/lib/go-1.10/src/fmt/print.go:78
# 0x4c7676 fmt.(*fmt).pad+0x106 /usr/lib/go-1.10/src/fmt/format.go:92
# 0x4c8f1e fmt.(*fmt).fmt_q+0x11e /usr/lib/go-1.10/src/fmt/format.go:420
# 0x4cbf2b fmt.(*pp).fmtString+0x7b /usr/lib/go-1.10/src/fmt/print.go:446
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef038 github.com/google/mtail/exporter.metricToPrometheus+0x1b8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [92: 17664] @ 0x4ca632 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 32] @ 0x4644ec 0x464316 0x46401f 0x6b7225 0x6b83b5 0x6bbabc 0x45b901
# 0x4644eb sync.(*Pool).pinSlow+0x1ab /usr/lib/go-1.10/src/sync/pool.go:208
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6b7224 net/http.newBufioWriterSize+0x154 /usr/lib/go-1.10/src/net/http/server.go:820
# 0x6b83b4 net/http.(*conn).readRequest+0x764 /usr/lib/go-1.10/src/net/http/server.go:1014
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [5: 1760] @ 0x4d2093 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d2092 fmt.(*buffer).WriteString+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4d2092 fmt.(*pp).doPrintf+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:964
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [18: 184320] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [1: 8] @ 0x4644ec 0x464316 0x46401f 0x4c9f51 0x4ca5c6 0x4ca6e7 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x4644eb sync.(*Pool).pinSlow+0x1ab /usr/lib/go-1.10/src/sync/pool.go:208
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca5c5 fmt.Sprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:202
# 0x4ca6e6 fmt.Errorf+0x56 /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [2: 13824] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [7: 112] @ 0x6ef423 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef422 github.com/google/mtail/exporter.metricToPrometheus+0x5a2 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:72
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [8: 1024] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [20: 1280] @ 0x458e39 0x430f80
# 0x458e38 runtime.systemstack+0x78 /usr/lib/go-1.10/src/runtime/asm_amd64.s:409
# 0x430f80 runtime.mstart+0x0 /usr/lib/go-1.10/src/runtime/proc.go:1175
0: 0 [3: 528] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 96] @ 0x42e9b2 0x405f53 0x405d7b 0x6f4a3a 0x45b901
# 0x6f4a39 github.com/google/mtail/watcher.(*LogWatcher).run+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:63
0: 0 [4: 192] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca452 0x6eedf6 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca451 fmt.Fprintf+0x71 /usr/lib/go-1.10/src/fmt/print.go:188
# 0x6eedf5 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x5d5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:43
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [9: 144] @ 0x4f33d1 0x6b812b 0x6bbabc 0x45b901
# 0x4f33d0 context.WithCancel+0x120 /usr/lib/go-1.10/src/context/context.go:233
# 0x6b812a net/http.(*conn).readRequest+0x4da /usr/lib/go-1.10/src/net/http/server.go:982
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [1: 187170816] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [2: 32] @ 0x463f58 0x4ca06e 0x4ca654 0x4ca6e7 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca653 fmt.Sprintf+0xb3 /usr/lib/go-1.10/src/fmt/print.go:205
# 0x4ca6e6 fmt.Errorf+0x56 /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [2: 16384] @ 0x46e83d 0x46e1f1 0x46ea8c 0x46ebf5 0x717c8f 0x71786a 0x719cc5 0x45b901
# 0x46e83c bytes.makeSlice+0x6c /usr/lib/go-1.10/src/bytes/buffer.go:230
# 0x46e1f0 bytes.(*Buffer).grow+0x150 /usr/lib/go-1.10/src/bytes/buffer.go:144
# 0x46ea8b bytes.(*Buffer).WriteByte+0x8b /usr/lib/go-1.10/src/bytes/buffer.go:268
# 0x46ebf4 bytes.(*Buffer).WriteRune+0x134 /usr/lib/go-1.10/src/bytes/buffer.go:280
# 0x717c8e github.com/google/mtail/tailer.(*Tailer).read+0xfe /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:241
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [2: 4096] @ 0x46e83d 0x46e1f1 0x46ea8c 0x46ebf5 0x717c8f 0x71786a 0x719cc5 0x45b901
# 0x46e83c bytes.makeSlice+0x6c /usr/lib/go-1.10/src/bytes/buffer.go:230
# 0x46e1f0 bytes.(*Buffer).grow+0x150 /usr/lib/go-1.10/src/bytes/buffer.go:144
# 0x46ea8b bytes.(*Buffer).WriteByte+0x8b /usr/lib/go-1.10/src/bytes/buffer.go:268
# 0x46ebf4 bytes.(*Buffer).WriteRune+0x134 /usr/lib/go-1.10/src/bytes/buffer.go:280
# 0x717c8e github.com/google/mtail/tailer.(*Tailer).read+0xfe /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:241
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [3: 960] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [3: 864] @ 0x4d2093 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d2092 fmt.(*buffer).WriteString+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4d2092 fmt.(*pp).doPrintf+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:964
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [27: 864] @ 0x64cb19 0x6b17b3 0x6b7dbf 0x6bbabc 0x45b901
# 0x64cb18 net/textproto.(*Reader).ReadMIMEHeader+0x278 /usr/lib/go-1.10/src/net/textproto/reader.go:520
# 0x6b17b2 net/http.readRequest+0x332 /usr/lib/go-1.10/src/net/http/request.go:976
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [2: 32] @ 0x463f58 0x6b1466 0x6d556f 0x6b1a0c 0x6b7dbf 0x6bbabc 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b1465 net/http.putTextprotoReader+0x55 /usr/lib/go-1.10/src/net/http/request.go:909
# 0x6d556e net/http.readRequest.func1+0x2e /usr/lib/go-1.10/src/net/http/request.go:933
# 0x6b1a0b net/http.readRequest+0x58b /usr/lib/go-1.10/src/net/http/request.go:1016
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [13: 2496] @ 0x4d71dd 0x46409b 0x4c9f51 0x4ca406 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d71dc fmt.glob..func1+0x2c /usr/lib/go-1.10/src/fmt/print.go:128
# 0x46409a sync.(*Pool).Get+0xaa /usr/lib/go-1.10/src/sync/pool.go:151
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca405 fmt.Fprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:187
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [39: 369408] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [5: 480] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [4: 64] @ 0x463f58 0x4ca06e 0x4ca4b1 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca4b0 fmt.Fprintf+0xd0 /usr/lib/go-1.10/src/fmt/print.go:190
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [16: 4096] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [24: 768] @ 0x64ab4c 0x6b150c 0x6b7dbf 0x6bbabc 0x45b901
# 0x64ab4b net/textproto.(*Reader).ReadLine+0x4b /usr/lib/go-1.10/src/net/textproto/reader.go:37
# 0x6b150b net/http.readRequest+0x8b /usr/lib/go-1.10/src/net/http/request.go:929
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [1: 93585408] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [2: 192] @ 0x458e39 0x430f80
# 0x458e38 runtime.systemstack+0x78 /usr/lib/go-1.10/src/runtime/asm_amd64.s:409
# 0x430f80 runtime.mstart+0x0 /usr/lib/go-1.10/src/runtime/proc.go:1175
0: 0 [4: 704] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [54: 864] @ 0x6eed66 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6eed65 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x545 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:46
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [24: 1152] @ 0x64d4a0 0x64c9c4 0x6b17b3 0x6b7dbf 0x6bbabc 0x45b901
# 0x64d49f net/textproto.canonicalMIMEHeaderKey+0x15f /usr/lib/go-1.10/src/net/textproto/reader.go:640
# 0x64c9c3 net/textproto.(*Reader).ReadMIMEHeader+0x123 /usr/lib/go-1.10/src/net/textproto/reader.go:506
# 0x6b17b2 net/http.readRequest+0x332 /usr/lib/go-1.10/src/net/http/request.go:976
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [19: 912] @ 0x64b51d 0x64ca15 0x6b17b3 0x6b7dbf 0x6bbabc 0x45b901
# 0x64b51c net/textproto.(*Reader).readContinuedLineSlice+0x3fc /usr/lib/go-1.10/src/net/textproto/reader.go:144
# 0x64ca14 net/textproto.(*Reader).ReadMIMEHeader+0x174 /usr/lib/go-1.10/src/net/textproto/reader.go:490
# 0x6b17b2 net/http.readRequest+0x332 /usr/lib/go-1.10/src/net/http/request.go:976
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [14: 57344] @ 0x464403 0x464316 0x463e6d 0x4ca06e 0x4ca4b1 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca4b0 fmt.Fprintf+0xd0 /usr/lib/go-1.10/src/fmt/print.go:190
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [2: 64] @ 0x463f58 0x4ca06e 0x4ca654 0x4ca6e7 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca653 fmt.Sprintf+0xb3 /usr/lib/go-1.10/src/fmt/print.go:205
# 0x4ca6e6 fmt.Errorf+0x56 /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [37: 1776] @ 0x409130 0x6ad951 0x6b8d14 0x6bae10 0x6baad6 0x4ca485 0x6eedf6 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ad950 net/http.Header.clone+0x60 /usr/lib/go-1.10/src/net/http/header.go:63
# 0x6b8d13 net/http.(*response).WriteHeader+0x223 /usr/lib/go-1.10/src/net/http/server.go:1088
# 0x6bae0f net/http.(*response).write+0x25f /usr/lib/go-1.10/src/net/http/server.go:1515
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eedf5 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x5d5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:43
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [20: 130560] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [3: 384] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [15: 240] @ 0x4dff74 0x6ef4ac 0x6eece5 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4dff73 strings.ToLower+0xb3 /usr/lib/go-1.10/src/strings/strings.go:597
# 0x6ef4ab github.com/google/mtail/exporter.kindToPrometheusType+0x4b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:82
# 0x6eece4 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x4c4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:46
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 46792704] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [11: 1056] @ 0x42e9b2 0x43ddd4 0x6f33d0 0x45b901
# 0x6f33cf github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x5af /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:284
0: 0 [5: 80] @ 0x463f58 0x6b7091 0x6bb1cf 0x6bb23b 0x6d59be 0x6bbe18 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b7090 net/http.putBufioReader+0xd0 /usr/lib/go-1.10/src/net/http/server.go:814
# 0x6bb1ce net/http.(*conn).finalFlush+0x9e /usr/lib/go-1.10/src/net/http/server.go:1603
# 0x6bb23a net/http.(*conn).close+0x2a /usr/lib/go-1.10/src/net/http/server.go:1618
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [24: 384] @ 0x64cb19 0x6b17b3 0x6b7dbf 0x6bbabc 0x45b901
# 0x64cb18 net/textproto.(*Reader).ReadMIMEHeader+0x278 /usr/lib/go-1.10/src/net/textproto/reader.go:520
# 0x6b17b2 net/http.readRequest+0x332 /usr/lib/go-1.10/src/net/http/request.go:976
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [22: 352] @ 0x4dffd3 0x6ef4ac 0x6eece5 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4dffd2 strings.ToLower+0x112 /usr/lib/go-1.10/src/strings/strings.go:605
# 0x6ef4ab github.com/google/mtail/exporter.kindToPrometheusType+0x4b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:82
# 0x6eece4 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x4c4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:46
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [38: 1824] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca452 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca451 fmt.Fprintf+0x71 /usr/lib/go-1.10/src/fmt/print.go:188
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 112] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [25: 1200] @ 0x409130 0x64c925 0x6b17b3 0x6b7dbf 0x6bbabc 0x45b901
# 0x64c924 net/textproto.(*Reader).ReadMIMEHeader+0x84 /usr/lib/go-1.10/src/net/textproto/reader.go:478
# 0x6b17b2 net/http.readRequest+0x332 /usr/lib/go-1.10/src/net/http/request.go:976
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [13: 208] @ 0x64a8a3 0x6ad733 0x6ee8fb 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x64a8a2 net/textproto.MIMEHeader.Add+0x162 /usr/lib/go-1.10/src/net/textproto/header.go:15
# 0x6ad732 net/http.Header.Add+0x52 /usr/lib/go-1.10/src/net/http/header.go:24
# 0x6ee8fa github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0xda /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:34
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [35: 1680] @ 0x4d2093 0x4ca606 0x4ca6e7 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x4d2092 fmt.(*buffer).WriteString+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4d2092 fmt.(*pp).doPrintf+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:964
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x4ca6e6 fmt.Errorf+0x56 /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [18: 576] @ 0x6d2cdd 0x46409b 0x6ade42 0x6ae31e 0x6b99d9 0x6b54fa 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6d2cdc net/http.glob..func13+0x2c /usr/lib/go-1.10/src/net/http/header.go:123
# 0x46409a sync.(*Pool).Get+0xaa /usr/lib/go-1.10/src/sync/pool.go:151
# 0x6ade41 net/http.Header.sortedKeyValues+0x41 /usr/lib/go-1.10/src/net/http/header.go:130
# 0x6ae31d net/http.Header.WriteSubset+0xbd /usr/lib/go-1.10/src/net/http/header.go:152
# 0x6b99d8 net/http.(*chunkWriter).writeHeader+0x8a8 /usr/lib/go-1.10/src/net/http/server.go:1411
# 0x6b54f9 net/http.(*chunkWriter).Write+0x2f9 /usr/lib/go-1.10/src/net/http/server.go:359
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [170: 43520] @ 0x6b14f1 0x6b7dbf 0x6bbabc 0x45b901
# 0x6b14f0 net/http.readRequest+0x70 /usr/lib/go-1.10/src/net/http/request.go:925
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [1: 23396352] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [31: 5952] @ 0x4d71dd 0x46409b 0x4c9f51 0x4ca406 0x6eedf6 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d71dc fmt.glob..func1+0x2c /usr/lib/go-1.10/src/fmt/print.go:128
# 0x46409a sync.(*Pool).Get+0xaa /usr/lib/go-1.10/src/sync/pool.go:151
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca405 fmt.Fprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:187
# 0x6eedf5 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x5d5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:43
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [2: 8192] @ 0x464403 0x464316 0x463e6d 0x4ca06e 0x4ca654 0x6ef039 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca653 fmt.Sprintf+0xb3 /usr/lib/go-1.10/src/fmt/print.go:205
# 0x6ef038 github.com/google/mtail/exporter.metricToPrometheus+0x1b8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [96: 9216] @ 0x4d2093 0x4ca452 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d2092 fmt.(*buffer).WriteString+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4d2092 fmt.(*pp).doPrintf+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:964
# 0x4ca451 fmt.Fprintf+0x71 /usr/lib/go-1.10/src/fmt/print.go:188
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [33: 405504] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [58: 928] @ 0x6eed2f 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6eed2e github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x50e /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:45
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [9: 144] @ 0x6ada1b 0x6b8d14 0x6bae10 0x6baad6 0x4ca485 0x6eedf6 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ada1a net/http.Header.clone+0x12a /usr/lib/go-1.10/src/net/http/header.go:65
# 0x6b8d13 net/http.(*response).WriteHeader+0x223 /usr/lib/go-1.10/src/net/http/server.go:1088
# 0x6bae0f net/http.(*response).write+0x25f /usr/lib/go-1.10/src/net/http/server.go:1515
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eedf5 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x5d5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:43
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [31: 2976] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca452 0x6eedf6 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca451 fmt.Fprintf+0x71 /usr/lib/go-1.10/src/fmt/print.go:188
# 0x6eedf5 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x5d5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:43
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [88: 9856] @ 0x6b825b 0x6bbabc 0x45b901
# 0x6b825a net/http.(*conn).readRequest+0x60a /usr/lib/go-1.10/src/net/http/server.go:1002
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [14: 224] @ 0x463f58 0x4ca06e 0x4ca827 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca826 fmt.Fprint+0xb6 /usr/lib/go-1.10/src/fmt/print.go:224
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [3: 480] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [26: 2080] @ 0x51adf1 0x6b666a 0x45b901
# 0x51adf0 net.(*conn).Read+0xb0 /usr/lib/go-1.10/src/net/net.go:178
# 0x6b6669 net/http.(*connReader).backgroundRead+0x59 /usr/lib/go-1.10/src/net/http/server.go:668
0: 0 [1: 11698176] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [196: 3136] @ 0x6b53b7 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6b53b6 net/http.(*chunkWriter).Write+0x1b6 /usr/lib/go-1.10/src/net/http/server.go:366
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [59: 4720] @ 0x4ca632 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [76: 9728] @ 0x564a0c 0x56488e 0x6b172b 0x6b7dbf 0x6bbabc 0x45b901
# 0x564a0b net/url.parse+0x5b /usr/lib/go-1.10/src/net/url/url.go:489
# 0x56488d net/url.ParseRequestURI+0x3d /usr/lib/go-1.10/src/net/url/url.go:471
# 0x6b172a net/http.readRequest+0x2aa /usr/lib/go-1.10/src/net/http/request.go:966
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [4: 16384] @ 0x464403 0x464316 0x463e6d 0x4ca06e 0x4ca827 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca826 fmt.Fprint+0xb6 /usr/lib/go-1.10/src/fmt/print.go:224
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [26: 1248] @ 0x6b13ab 0x6b14d7 0x6b7dbf 0x6bbabc 0x45b901
# 0x6b13aa net/textproto.NewReader+0x8a /usr/lib/go-1.10/src/net/textproto/reader.go:30
# 0x6b13aa net/http.newTextprotoReader+0x8a /usr/lib/go-1.10/src/net/http/request.go:904
# 0x6b14d6 net/http.readRequest+0x56 /usr/lib/go-1.10/src/net/http/request.go:924
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [31: 1488] @ 0x408f3d 0x4f359c 0x4f33c1 0x6b812b 0x6bbabc 0x45b901
# 0x4f359b context.propagateCancel+0x10b /usr/lib/go-1.10/src/context/context.go:253
# 0x4f33c0 context.WithCancel+0x110 /usr/lib/go-1.10/src/context/context.go:232
# 0x6b812a net/http.(*conn).readRequest+0x4da /usr/lib/go-1.10/src/net/http/server.go:982
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [44: 2816] @ 0x4f32ef 0x6b812b 0x6bbabc 0x45b901
# 0x4f32ee context.WithCancel+0x3e /usr/lib/go-1.10/src/context/context.go:231
# 0x6b812a net/http.(*conn).readRequest+0x4da /usr/lib/go-1.10/src/net/http/server.go:982
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [2: 8192] @ 0x464403 0x464316 0x46401f 0x4c9f51 0x4ca5c6 0x6ef039 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca5c5 fmt.Sprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:202
# 0x6ef038 github.com/google/mtail/exporter.metricToPrometheus+0x1b8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [23: 6624] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [26: 4992] @ 0x4d71dd 0x46409b 0x4c9f51 0x4ca406 0x6b5423 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d71dc fmt.glob..func1+0x2c /usr/lib/go-1.10/src/fmt/print.go:128
# 0x46409a sync.(*Pool).Get+0xaa /usr/lib/go-1.10/src/sync/pool.go:151
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca405 fmt.Fprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:187
# 0x6b5422 net/http.(*chunkWriter).Write+0x222 /usr/lib/go-1.10/src/net/http/server.go:366
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [119: 1904] @ 0x4ca632 0x6e76aa 0x6ef1da 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6e76a9 github.com/google/mtail/metrics/datum.(*FloatDatum).ValueString+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/datum/float.go:23
# 0x6ef1d9 github.com/google/mtail/exporter.metricToPrometheus+0x359 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:77
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [4: 64] @ 0x463f58 0x6b73b4 0x6bae8c 0x6bbc71 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b73b3 net/http.putBufioWriter+0xa3 /usr/lib/go-1.10/src/net/http/server.go:832
# 0x6bae8b net/http.(*response).finishRequest+0x5b /usr/lib/go-1.10/src/net/http/server.go:1543
# 0x6bbc70 net/http.(*conn).serve+0x690 /usr/lib/go-1.10/src/net/http/server.go:1835
0: 0 [65: 6240] @ 0x64cb19 0x6b17b3 0x6b7dbf 0x6bbabc 0x45b901
# 0x64cb18 net/textproto.(*Reader).ReadMIMEHeader+0x278 /usr/lib/go-1.10/src/net/textproto/reader.go:520
# 0x6b17b2 net/http.readRequest+0x332 /usr/lib/go-1.10/src/net/http/request.go:976
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [3: 48] @ 0x6b53b7 0x473bae 0x6bae7a 0x6bbc71 0x45b901
# 0x6b53b6 net/http.(*chunkWriter).Write+0x1b6 /usr/lib/go-1.10/src/net/http/server.go:366
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x6bae79 net/http.(*response).finishRequest+0x49 /usr/lib/go-1.10/src/net/http/server.go:1542
# 0x6bbc70 net/http.(*conn).serve+0x690 /usr/lib/go-1.10/src/net/http/server.go:1835
0: 0 [552: 8832] @ 0x6e7661 0x6ef1da 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6e7660 github.com/google/mtail/metrics/datum.(*FloatDatum).ValueString+0x50 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/datum/float.go:23
# 0x6ef1d9 github.com/google/mtail/exporter.metricToPrometheus+0x359 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:77
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [65: 224640] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [63: 5040] @ 0x64d007 0x6b17b3 0x6b7dbf 0x6bbabc 0x45b901
# 0x64d006 net/textproto.(*Reader).ReadMIMEHeader+0x766 /usr/lib/go-1.10/src/net/textproto/reader.go:475
# 0x6b17b2 net/http.readRequest+0x332 /usr/lib/go-1.10/src/net/http/request.go:976
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [1: 5849088] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [998: 111776] @ 0x4ca632 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [94: 15040] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [4: 256] @ 0x463f58 0x6b7091 0x6bb1cf 0x6bb23b 0x6d59be 0x6bbe18 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b7090 net/http.putBufioReader+0xd0 /usr/lib/go-1.10/src/net/http/server.go:814
# 0x6bb1ce net/http.(*conn).finalFlush+0x9e /usr/lib/go-1.10/src/net/http/server.go:1603
# 0x6bb23a net/http.(*conn).close+0x2a /usr/lib/go-1.10/src/net/http/server.go:1618
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [319: 30624] @ 0x6eec5c 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6eec5b github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x43b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:50
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [333: 1363968] @ 0x464403 0x464316 0x46401f 0x6b1351 0x6b14d7 0x6b7dbf 0x6bbabc 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6b1350 net/http.newTextprotoReader+0x30 /usr/lib/go-1.10/src/net/http/request.go:899
# 0x6b14d6 net/http.readRequest+0x56 /usr/lib/go-1.10/src/net/http/request.go:924
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [24: 1152] @ 0x6adeaf 0x6ae31e 0x6b99d9 0x6b54fa 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6adeae net/http.Header.sortedKeyValues+0xae /usr/lib/go-1.10/src/net/http/header.go:132
# 0x6ae31d net/http.Header.WriteSubset+0xbd /usr/lib/go-1.10/src/net/http/header.go:152
# 0x6b99d8 net/http.(*chunkWriter).writeHeader+0x8a8 /usr/lib/go-1.10/src/net/http/server.go:1411
# 0x6b54f9 net/http.(*chunkWriter).Write+0x2f9 /usr/lib/go-1.10/src/net/http/server.go:359
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1568: 50176] @ 0x4ca632 0x6e76aa 0x6ef1da 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6e76a9 github.com/google/mtail/metrics/datum.(*FloatDatum).ValueString+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/datum/float.go:23
# 0x6ef1d9 github.com/google/mtail/exporter.metricToPrometheus+0x359 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:77
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [4: 32] @ 0x522b8d 0x524768 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x522b8c net.newTCPConn+0x2c /usr/lib/go-1.10/src/net/tcpsock.go:194
# 0x524767 net.(*TCPListener).accept+0x67 /usr/lib/go-1.10/src/net/tcpsock_posix.go:140
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
0: 0 [24: 1536] @ 0x6b7198 0x6bba49 0x45b901
# 0x6b7197 bufio.NewWriterSize+0xc7 /usr/lib/go-1.10/src/bufio/bufio.go:543
# 0x6b7197 net/http.newBufioWriterSize+0xc7 /usr/lib/go-1.10/src/net/http/server.go:826
# 0x6bba48 net/http.(*conn).serve+0x468 /usr/lib/go-1.10/src/net/http/server.go:1765
0: 0 [1: 2924544] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [14: 2016] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [262: 92224] @ 0x40d6fc 0x64a82c 0x6ad733 0x6ee8fb 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x64a82b net/textproto.MIMEHeader.Add+0xeb /usr/lib/go-1.10/src/net/textproto/header.go:15
# 0x6ad732 net/http.Header.Add+0x52 /usr/lib/go-1.10/src/net/http/header.go:24
# 0x6ee8fa github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0xda /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:34
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [24: 1152] @ 0x523c9e 0x50a8ad 0x52472e 0x522d09 0x6c0f5f 0x6bfcf5 0x6bfa49 0x6c0a8a 0x75434e 0x45b901
# 0x523c9d net.sockaddrToTCP+0xcd /usr/lib/go-1.10/src/net/tcpsock_posix.go:21
# 0x50a8ac net.(*netFD).accept+0x33c /usr/lib/go-1.10/src/net/fd_unix.go:255
# 0x52472d net.(*TCPListener).accept+0x2d /usr/lib/go-1.10/src/net/tcpsock_posix.go:136
# 0x522d08 net.(*TCPListener).AcceptTCP+0x48 /usr/lib/go-1.10/src/net/tcpsock.go:246
# 0x6c0f5e net/http.tcpKeepAliveListener.Accept+0x2e /usr/lib/go-1.10/src/net/http/server.go:3216
# 0x6bfcf4 net/http.(*Server).Serve+0x1a4 /usr/lib/go-1.10/src/net/http/server.go:2770
# 0x6bfa48 net/http.(*Server).ListenAndServe+0xa8 /usr/lib/go-1.10/src/net/http/server.go:2711
# 0x6c0a89 net/http.ListenAndServe+0x79 /usr/lib/go-1.10/src/net/http/server.go:2969
# 0x75434d github.com/google/mtail/mtail.(*MtailServer).Serve.func1+0xbd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:217
0: 0 [370: 5920] @ 0x6b53b7 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6b53b6 net/http.(*chunkWriter).Write+0x1b6 /usr/lib/go-1.10/src/net/http/server.go:366
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [2: 32] @ 0x488ffe 0x486d89 0x4a1892 0x50a15f 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x488ffd syscall.errnoErr+0xcd /usr/lib/go-1.10/src/syscall/syscall_unix.go:142
# 0x488ffd syscall.write+0xcd /usr/lib/go-1.10/src/syscall/zsyscall_linux_amd64.go:1025
# 0x486d88 syscall.Write+0x48 /usr/lib/go-1.10/src/syscall/syscall_unix.go:181
# 0x4a1891 internal/poll.(*FD).Write+0x141 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:256
# 0x50a15e net.(*netFD).Write+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:220
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [692: 2834432] @ 0x464403 0x464316 0x46401f 0x6ade42 0x6ae31e 0x6b99d9 0x6b54fa 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6ade41 net/http.Header.sortedKeyValues+0x41 /usr/lib/go-1.10/src/net/http/header.go:130
# 0x6ae31d net/http.Header.WriteSubset+0xbd /usr/lib/go-1.10/src/net/http/header.go:152
# 0x6b99d8 net/http.(*chunkWriter).writeHeader+0x8a8 /usr/lib/go-1.10/src/net/http/server.go:1411
# 0x6b54f9 net/http.(*chunkWriter).Write+0x2f9 /usr/lib/go-1.10/src/net/http/server.go:359
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [92: 32384] @ 0x408ee9 0x40d67e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [257: 90464] @ 0x40d6fc 0x64cd95 0x6b17b3 0x6b7dbf 0x6bbabc 0x45b901
# 0x64cd94 net/textproto.(*Reader).ReadMIMEHeader+0x4f4 /usr/lib/go-1.10/src/net/textproto/reader.go:530
# 0x6b17b2 net/http.readRequest+0x332 /usr/lib/go-1.10/src/net/http/request.go:976
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [9: 61056] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [233: 82016] @ 0x40d6fc 0x6adaa7 0x6b8d14 0x6bae10 0x6baad6 0x4ca485 0x6eedf6 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6adaa6 net/http.Header.clone+0x1b6 /usr/lib/go-1.10/src/net/http/header.go:67
# 0x6b8d13 net/http.(*response).WriteHeader+0x223 /usr/lib/go-1.10/src/net/http/server.go:1088
# 0x6bae0f net/http.(*response).write+0x25f /usr/lib/go-1.10/src/net/http/server.go:1515
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eedf5 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x5d5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:43
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 192] @ 0x4d71dd 0x46409b 0x4c9f51 0x4ca5c6 0x6e7bda 0x6ef1da 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d71dc fmt.glob..func1+0x2c /usr/lib/go-1.10/src/fmt/print.go:128
# 0x46409a sync.(*Pool).Get+0xaa /usr/lib/go-1.10/src/sync/pool.go:151
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca5c5 fmt.Sprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:202
# 0x6e7bd9 github.com/google/mtail/metrics/datum.(*IntDatum).ValueString+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/datum/int.go:43
# 0x6ef1d9 github.com/google/mtail/exporter.metricToPrometheus+0x359 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:77
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 1466368] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [9711: 932256] @ 0x4df36d 0x6ef1a6 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4df36c strings.Join+0xac /usr/lib/go-1.10/src/strings/strings.go:435
# 0x6ef1a5 github.com/google/mtail/exporter.metricToPrometheus+0x325 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [42: 2688] @ 0x6b7198 0x6b83b5 0x6bbabc 0x45b901
# 0x6b7197 bufio.NewWriterSize+0xc7 /usr/lib/go-1.10/src/bufio/bufio.go:543
# 0x6b7197 net/http.newBufioWriterSize+0xc7 /usr/lib/go-1.10/src/net/http/server.go:826
# 0x6b83b4 net/http.(*conn).readRequest+0x764 /usr/lib/go-1.10/src/net/http/server.go:1014
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [7: 672] @ 0x42e9b2 0x405f53 0x405d7b 0x6eea65 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6eea64 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x244 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:52
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [218: 41856] @ 0x4c7a27 0x4c8761 0x4cc047 0x4cdf29 0x4d10f7 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7a26 fmt.(*buffer).WriteString+0x106 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4c7a26 fmt.(*fmt).padString+0x106 /usr/lib/go-1.10/src/fmt/format.go:110
# 0x4c8760 fmt.(*fmt).fmt_s+0x60 /usr/lib/go-1.10/src/fmt/format.go:328
# 0x4cc046 fmt.(*pp).fmtString+0x196 /usr/lib/go-1.10/src/fmt/print.go:440
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [5: 160] @ 0x4644ec 0x464316 0x46401f 0x6b1351 0x6b14d7 0x6b7dbf 0x6bbabc 0x45b901
# 0x4644eb sync.(*Pool).pinSlow+0x1ab /usr/lib/go-1.10/src/sync/pool.go:208
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6b1350 net/http.newTextprotoReader+0x30 /usr/lib/go-1.10/src/net/http/request.go:899
# 0x6b14d6 net/http.readRequest+0x56 /usr/lib/go-1.10/src/net/http/request.go:924
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [133: 19152] @ 0x717d1e 0x71786a 0x719cc5 0x45b901
# 0x717d1d bytes.(*Buffer).String+0x18d /usr/lib/go-1.10/src/bytes/buffer.go:66
# 0x717d1d github.com/google/mtail/tailer.(*Tailer).read+0x18d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [318: 1302528] @ 0x464403 0x464316 0x463e6d 0x6b1466 0x6d556f 0x6b1a0c 0x6b7dbf 0x6bbabc 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x6b1465 net/http.putTextprotoReader+0x55 /usr/lib/go-1.10/src/net/http/request.go:909
# 0x6d556e net/http.readRequest.func1+0x2e /usr/lib/go-1.10/src/net/http/request.go:933
# 0x6b1a0b net/http.readRequest+0x58b /usr/lib/go-1.10/src/net/http/request.go:1016
# 0x6b7dbe net/http.(*conn).readRequest+0x16e /usr/lib/go-1.10/src/net/http/server.go:944
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [2586: 41376] @ 0x748266 0x74b533 0x74b6a5 0x45b901
# 0x748265 github.com/google/mtail/vm.(*VM).execute+0x1f25 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:568
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [5: 320] @ 0x4644ec 0x464316 0x46401f 0x4c9f51 0x4ca406 0x6eedf6 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4644eb sync.(*Pool).pinSlow+0x1ab /usr/lib/go-1.10/src/sync/pool.go:208
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca405 fmt.Fprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:187
# 0x6eedf5 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x5d5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:43
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [43: 2064] @ 0x408f3d 0x6b8236 0x6bbabc 0x45b901
# 0x6b8235 net/http.(*conn).readRequest+0x5e5 /usr/lib/go-1.10/src/net/http/server.go:1000
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [1: 737280] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [2: 8192] @ 0x464403 0x464316 0x463e6d 0x4ca06e 0x4ca654 0x4ca6e7 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca653 fmt.Sprintf+0xb3 /usr/lib/go-1.10/src/fmt/print.go:205
# 0x4ca6e6 fmt.Errorf+0x56 /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [25560: 1226880] @ 0x4ca632 0x6ef039 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef038 github.com/google/mtail/exporter.metricToPrometheus+0x1b8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [17541: 280656] @ 0x6eeb3e 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6eeb3d github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x31d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [17459: 279344] @ 0x6ef291 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef290 github.com/google/mtail/exporter.metricToPrometheus+0x410 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:77
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [154: 34496] @ 0x6b82ac 0x6bbabc 0x45b901
# 0x6b82ab net/http.(*conn).readRequest+0x65b /usr/lib/go-1.10/src/net/http/server.go:1008
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [4: 64] @ 0x51de2b 0x510334 0x510646 0x521a3d 0x6bb640 0x45b901
# 0x51de2a net.uitoa+0xca /usr/lib/go-1.10/src/net/parse.go:204
# 0x510333 net.IP.String+0x3d3 /usr/lib/go-1.10/src/net/ip.go:278
# 0x510645 net.ipEmptyString+0x55 /usr/lib/go-1.10/src/net/ip.go:340
# 0x521a3c net.(*TCPAddr).String+0x4c /usr/lib/go-1.10/src/net/tcpsock.go:32
# 0x6bb63f net/http.(*conn).serve+0x5f /usr/lib/go-1.10/src/net/http/server.go:1720
0: 0 [9558: 917568] @ 0x4df576 0x6ef1a6 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4df575 strings.Join+0x2b5 /usr/lib/go-1.10/src/strings/strings.go:441
# 0x6ef1a5 github.com/google/mtail/exporter.metricToPrometheus+0x325 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 64] @ 0x463f58 0x6b73b4 0x6bb19a 0x6bb23b 0x6d59be 0x6bbe18 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b73b3 net/http.putBufioWriter+0xa3 /usr/lib/go-1.10/src/net/http/server.go:832
# 0x6bb199 net/http.(*conn).finalFlush+0x69 /usr/lib/go-1.10/src/net/http/server.go:1611
# 0x6bb23a net/http.(*conn).close+0x2a /usr/lib/go-1.10/src/net/http/server.go:1618
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [9: 2880] @ 0x4d2093 0x4ca606 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d2092 fmt.(*buffer).WriteString+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4d2092 fmt.(*pp).doPrintf+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:964
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 368640] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [1227: 2512896] @ 0x6b716a 0x6b83b5 0x6bbabc 0x45b901
# 0x6b7169 bufio.NewWriterSize+0x99 /usr/lib/go-1.10/src/bufio/bufio.go:544
# 0x6b7169 net/http.newBufioWriterSize+0x99 /usr/lib/go-1.10/src/net/http/server.go:826
# 0x6b83b4 net/http.(*conn).readRequest+0x764 /usr/lib/go-1.10/src/net/http/server.go:1014
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [35112: 1123584] @ 0x4ca632 0x6ef38d 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef38c github.com/google/mtail/exporter.metricToPrometheus+0x50c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:72
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [8: 128] @ 0x4f33d1 0x6bb967 0x45b901
# 0x4f33d0 context.WithCancel+0x120 /usr/lib/go-1.10/src/context/context.go:233
# 0x6bb966 net/http.(*conn).serve+0x386 /usr/lib/go-1.10/src/net/http/server.go:1759
0: 0 [2: 32] @ 0x463f58 0x6b73b4 0x6bb19a 0x6bb23b 0x6d59be 0x6bbe18 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b73b3 net/http.putBufioWriter+0xa3 /usr/lib/go-1.10/src/net/http/server.go:832
# 0x6bb199 net/http.(*conn).finalFlush+0x69 /usr/lib/go-1.10/src/net/http/server.go:1611
# 0x6bb23a net/http.(*conn).close+0x2a /usr/lib/go-1.10/src/net/http/server.go:1618
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [7880: 126080] @ 0x4ca632 0x6e7bda 0x6ef1da 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6e7bd9 github.com/google/mtail/metrics/datum.(*IntDatum).ValueString+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/datum/int.go:43
# 0x6ef1d9 github.com/google/mtail/exporter.metricToPrometheus+0x359 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:77
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [8305: 132880] @ 0x6e7b91 0x6ef1da 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6e7b90 github.com/google/mtail/metrics/datum.(*IntDatum).ValueString+0x50 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/datum/int.go:43
# 0x6ef1d9 github.com/google/mtail/exporter.metricToPrometheus+0x359 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:77
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [18788: 1503040] @ 0x4df576 0x6ef1a6 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4df575 strings.Join+0x2b5 /usr/lib/go-1.10/src/strings/strings.go:441
# 0x6ef1a5 github.com/google/mtail/exporter.metricToPrometheus+0x325 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [23: 94208] @ 0x464403 0x464316 0x463e6d 0x6b73b4 0x6bae8c 0x6bbc71 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x6b73b3 net/http.putBufioWriter+0xa3 /usr/lib/go-1.10/src/net/http/server.go:832
# 0x6bae8b net/http.(*response).finishRequest+0x5b /usr/lib/go-1.10/src/net/http/server.go:1543
# 0x6bbc70 net/http.(*conn).serve+0x690 /usr/lib/go-1.10/src/net/http/server.go:1835
0: 0 [1: 16] @ 0x488ffe 0x486d89 0x4a1892 0x50a15f 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x488ffd syscall.errnoErr+0xcd /usr/lib/go-1.10/src/syscall/syscall_unix.go:142
# 0x488ffd syscall.write+0xcd /usr/lib/go-1.10/src/syscall/zsyscall_linux_amd64.go:1025
# 0x486d88 syscall.Write+0x48 /usr/lib/go-1.10/src/syscall/syscall_unix.go:181
# 0x4a1891 internal/poll.(*FD).Write+0x141 /usr/lib/go-1.10/src/internal/poll/fd_unix.go:256
# 0x50a15e net.(*netFD).Write+0x4e /usr/lib/go-1.10/src/net/fd_unix.go:220
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 188416] @ 0x40aa12 0x40ab90 0x40d58e 0x74a3e8 0x74b533 0x74b6a5 0x45b901
# 0x74a3e7 github.com/google/mtail/vm.(*VM).execute+0x40a7 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:524
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [1: 32] @ 0x463f58 0x6b73b4 0x6bae8c 0x6bbc71 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b73b3 net/http.putBufioWriter+0xa3 /usr/lib/go-1.10/src/net/http/server.go:832
# 0x6bae8b net/http.(*response).finishRequest+0x5b /usr/lib/go-1.10/src/net/http/server.go:1543
# 0x6bbc70 net/http.(*conn).serve+0x690 /usr/lib/go-1.10/src/net/http/server.go:1835
0: 0 [7: 336] @ 0x458e39 0x430f80
# 0x458e38 runtime.systemstack+0x78 /usr/lib/go-1.10/src/runtime/asm_amd64.s:409
# 0x430f80 runtime.mstart+0x0 /usr/lib/go-1.10/src/runtime/proc.go:1175
0: 0 [17517: 280272] @ 0x6ee9cf 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ee9ce github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x1ae /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [35009: 1120288] @ 0x6ef0cf 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef0ce github.com/google/mtail/exporter.metricToPrometheus+0x24e /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [28698: 3673344] @ 0x4ca632 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [35079: 1122528] @ 0x6eb16e 0x45b901
# 0x6eb16d github.com/google/mtail/metrics.(*Metric).EmitLabelSets+0xdd /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:178
0: 0 [17671: 282736] @ 0x6eeb03 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6eeb02 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x2e2 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [17596: 281536] @ 0x6ef25d 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef25c github.com/google/mtail/exporter.metricToPrometheus+0x3dc /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [103: 19776] @ 0x4d71dd 0x46409b 0x4c9f51 0x4ca5c6 0x4ca6e7 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x4d71dc fmt.glob..func1+0x2c /usr/lib/go-1.10/src/fmt/print.go:128
# 0x46409a sync.(*Pool).Get+0xaa /usr/lib/go-1.10/src/sync/pool.go:151
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca5c5 fmt.Sprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:202
# 0x4ca6e6 fmt.Errorf+0x56 /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [1: 16] @ 0x4c7677 0x4c8f1f 0x4cbf2c 0x4cdf29 0x4d10f7 0x4ca606 0x6ef039 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7676 fmt.(*buffer).Write+0x106 /usr/lib/go-1.10/src/fmt/print.go:78
# 0x4c7676 fmt.(*fmt).pad+0x106 /usr/lib/go-1.10/src/fmt/format.go:92
# 0x4c8f1e fmt.(*fmt).fmt_q+0x11e /usr/lib/go-1.10/src/fmt/format.go:420
# 0x4cbf2b fmt.(*pp).fmtString+0x7b /usr/lib/go-1.10/src/fmt/print.go:446
# 0x4cdf28 fmt.(*pp).printArg+0x788 /usr/lib/go-1.10/src/fmt/print.go:671
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca605 fmt.Sprintf+0x65 /usr/lib/go-1.10/src/fmt/print.go:203
# 0x6ef038 github.com/google/mtail/exporter.metricToPrometheus+0x1b8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [74315: 11890400] @ 0x4ca632 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 16] @ 0x4c7677 0x4c82db 0x4cbadd 0x4cdfd7 0x4d10f7 0x4ca452 0x6b5423 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4c7676 fmt.(*buffer).Write+0x106 /usr/lib/go-1.10/src/fmt/print.go:78
# 0x4c7676 fmt.(*fmt).pad+0x106 /usr/lib/go-1.10/src/fmt/format.go:92
# 0x4c82da fmt.(*fmt).fmt_integer+0x1da /usr/lib/go-1.10/src/fmt/format.go:307
# 0x4cbadc fmt.(*pp).fmtInteger+0x2fc /usr/lib/go-1.10/src/fmt/print.go:375
# 0x4cdfd6 fmt.(*pp).printArg+0x836 /usr/lib/go-1.10/src/fmt/print.go:649
# 0x4d10f6 fmt.(*pp).doPrintf+0x156 /usr/lib/go-1.10/src/fmt/print.go:1003
# 0x4ca451 fmt.Fprintf+0x71 /usr/lib/go-1.10/src/fmt/print.go:188
# 0x6b5422 net/http.(*chunkWriter).Write+0x222 /usr/lib/go-1.10/src/net/http/server.go:366
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [670: 2744320] @ 0x464403 0x464316 0x46401f 0x6b7225 0x6b83b5 0x6bbabc 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6b7224 net/http.newBufioWriterSize+0x154 /usr/lib/go-1.10/src/net/http/server.go:820
# 0x6b83b4 net/http.(*conn).readRequest+0x764 /usr/lib/go-1.10/src/net/http/server.go:1014
# 0x6bbabb net/http.(*conn).serve+0x4db /usr/lib/go-1.10/src/net/http/server.go:1768
0: 0 [15038: 481216] @ 0x74ab8a 0x74b533 0x74b6a5 0x45b901
# 0x74ab89 github.com/google/mtail/vm.(*thread).Push+0x4849 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:192
# 0x74ab89 github.com/google/mtail/vm.(*VM).execute+0x4849 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:547
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [1: 16] @ 0x51de2b 0x51dd34 0x521b2e 0x6bb640 0x45b901
# 0x51de2a net.uitoa+0xca /usr/lib/go-1.10/src/net/parse.go:204
# 0x51dd33 net.itoa+0x93 /usr/lib/go-1.10/src/net/parse.go:186
# 0x521b2d net.(*TCPAddr).String+0x13d /usr/lib/go-1.10/src/net/tcpsock.go:36
# 0x6bb63f net/http.(*conn).serve+0x5f /usr/lib/go-1.10/src/net/http/server.go:1720
0: 0 [67207: 1075312] @ 0x6eefb0 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6eefaf github.com/google/mtail/exporter.metricToPrometheus+0x12f /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [15433: 493856] @ 0x717d42 0x71786a 0x719cc5 0x45b901
# 0x717d41 github.com/google/mtail/tailer.NewLogLine+0x1b1 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/logline.go:14
# 0x717d41 github.com/google/mtail/tailer.(*Tailer).read+0x1b1 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:244
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [2: 64] @ 0x463f58 0x6b7091 0x6bb1cf 0x6bb23b 0x6d59be 0x6bbe18 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b7090 net/http.putBufioReader+0xd0 /usr/lib/go-1.10/src/net/http/server.go:814
# 0x6bb1ce net/http.(*conn).finalFlush+0x9e /usr/lib/go-1.10/src/net/http/server.go:1603
# 0x6bb23a net/http.(*conn).close+0x2a /usr/lib/go-1.10/src/net/http/server.go:1618
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [42347: 5420416] @ 0x4df576 0x6ef1a6 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4df575 strings.Join+0x2b5 /usr/lib/go-1.10/src/strings/strings.go:441
# 0x6ef1a5 github.com/google/mtail/exporter.metricToPrometheus+0x325 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [54202: 9539552] @ 0x4ca632 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [35249: 1127968] @ 0x4d8ba5 0x6ef109 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d8ba4 sort.Strings+0x54 /usr/lib/go-1.10/src/sort/sort.go:314
# 0x6ef108 github.com/google/mtail/exporter.metricToPrometheus+0x288 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:70
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [17688: 283008] @ 0x6ef226 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef225 github.com/google/mtail/exporter.metricToPrometheus+0x3a5 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:75
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [67616: 1081856] @ 0x6eefe7 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6eefe6 github.com/google/mtail/exporter.metricToPrometheus+0x166 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [21184: 1355776] @ 0x4ca632 0x6ef039 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef038 github.com/google/mtail/exporter.metricToPrometheus+0x1b8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [115405: 14771840] @ 0x6ef423 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef422 github.com/google/mtail/exporter.metricToPrometheus+0x5a2 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:72
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [48539: 5436368] @ 0x4df576 0x6ef1a6 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4df575 strings.Join+0x2b5 /usr/lib/go-1.10/src/strings/strings.go:441
# 0x6ef1a5 github.com/google/mtail/exporter.metricToPrometheus+0x325 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [136: 26112] @ 0x4d71dd 0x46409b 0x4c9f51 0x4ca406 0x6b5423 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca7fb 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d71dc fmt.glob..func1+0x2c /usr/lib/go-1.10/src/fmt/print.go:128
# 0x46409a sync.(*Pool).Get+0xaa /usr/lib/go-1.10/src/sync/pool.go:151
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca405 fmt.Fprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:187
# 0x6b5422 net/http.(*chunkWriter).Write+0x222 /usr/lib/go-1.10/src/net/http/server.go:366
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca7fa fmt.Fprint+0x8a /usr/lib/go-1.10/src/fmt/print.go:223
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [12971: 1867824] @ 0x4ca632 0x6ef2e3 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef2e2 github.com/google/mtail/exporter.metricToPrometheus+0x462 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:74
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 4096] @ 0x464403 0x464316 0x46401f 0x4c9f51 0x4ca796 0x6eea4a 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca795 fmt.Fprint+0x25 /usr/lib/go-1.10/src/fmt/print.go:221
# 0x6eea49 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x229 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:57
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [23233: 1115184] @ 0x446b2f 0x44668a 0x4468e7 0x6f3239 0x45b901
# 0x6f3238 github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x418 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:277
0: 0 [7877: 126032] @ 0x7499bd 0x74b533 0x74b6a5 0x45b901
# 0x7499bc github.com/google/mtail/vm.(*thread).Push+0x367c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:192
# 0x7499bc github.com/google/mtail/vm.(*VM).execute+0x367c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:428
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [23061: 1106928] @ 0x4ca632 0x4ca6e7 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x4ca6e6 fmt.Errorf+0x56 /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [48791: 5464592] @ 0x4df36d 0x6ef1a6 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4df36c strings.Join+0xac /usr/lib/go-1.10/src/strings/strings.go:435
# 0x6ef1a5 github.com/google/mtail/exporter.metricToPrometheus+0x325 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [17547: 280752] @ 0x6ef33b 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef33a github.com/google/mtail/exporter.metricToPrometheus+0x4ba /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:72
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [17651: 282416] @ 0x6ef0cf 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef0ce github.com/google/mtail/exporter.metricToPrometheus+0x24e /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 32] @ 0x463f58 0x6b73b4 0x6bb19a 0x6bb23b 0x6d59be 0x6bbe18 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x6b73b3 net/http.putBufioWriter+0xa3 /usr/lib/go-1.10/src/net/http/server.go:832
# 0x6bb199 net/http.(*conn).finalFlush+0x69 /usr/lib/go-1.10/src/net/http/server.go:1611
# 0x6bb23a net/http.(*conn).close+0x2a /usr/lib/go-1.10/src/net/http/server.go:1618
# 0x6d59bd net/http.(*conn).serve.func1+0x20d /usr/lib/go-1.10/src/net/http/server.go:1730
# 0x6bbe17 net/http.(*conn).serve+0x837 /usr/lib/go-1.10/src/net/http/server.go:1840
0: 0 [90519: 4344912] @ 0x7464c2 0x74b533 0x74b6a5 0x45b901
# 0x7464c1 github.com/google/mtail/vm.(*VM).execute+0x181 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:635
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [23183: 1112784] @ 0x409130 0x74b4bc 0x74b6a5 0x45b901
# 0x74b4bb github.com/google/mtail/vm.(*VM).processLine+0xdb /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:749
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [18849: 1507920] @ 0x4df36d 0x6ef1a6 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4df36c strings.Join+0xac /usr/lib/go-1.10/src/strings/strings.go:435
# 0x6ef1a5 github.com/google/mtail/exporter.metricToPrometheus+0x325 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [43848: 701568] @ 0x4ca632 0x6ef039 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4ca631 fmt.Sprintf+0x91 /usr/lib/go-1.10/src/fmt/print.go:204
# 0x6ef038 github.com/google/mtail/exporter.metricToPrometheus+0x1b8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [70619: 4519616] @ 0x6ef0cf 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6ef0ce github.com/google/mtail/exporter.metricToPrometheus+0x24e /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:68
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 8] @ 0x4644ec 0x464316 0x46401f 0x6b6cff 0x6bba08 0x45b901
# 0x4644eb sync.(*Pool).pinSlow+0x1ab /usr/lib/go-1.10/src/sync/pool.go:208
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6b6cfe net/http.newBufioReader+0x3e /usr/lib/go-1.10/src/net/http/server.go:802
# 0x6bba07 net/http.(*conn).serve+0x427 /usr/lib/go-1.10/src/net/http/server.go:1764
0: 0 [1: 16] @ 0x4644ec 0x464316 0x46401f 0x6b7225 0x6bba49 0x45b901
# 0x4644eb sync.(*Pool).pinSlow+0x1ab /usr/lib/go-1.10/src/sync/pool.go:208
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x6b7224 net/http.newBufioWriterSize+0x154 /usr/lib/go-1.10/src/net/http/server.go:820
# 0x6bba48 net/http.(*conn).serve+0x468 /usr/lib/go-1.10/src/net/http/server.go:1765
0: 0 [5023: 80368] @ 0x749013 0x74b533 0x74b6a5 0x45b901
# 0x749012 github.com/google/mtail/vm.(*VM).execute+0x2cd2 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:704
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [38061: 3044880] @ 0x74b411 0x74b6a5 0x45b901
# 0x74b410 github.com/google/mtail/vm.(*VM).processLine+0x30 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:744
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [15200: 486400] @ 0x4e060f 0x4e0781 0x6f31ec 0x45b901
# 0x4e060e strings.makeCutsetFunc+0x17e /usr/lib/go-1.10/src/strings/strings.go:772
# 0x4e0780 strings.TrimRight+0x60 /usr/lib/go-1.10/src/strings/strings.go:808
# 0x6f31eb github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x3cb /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:277
0: 0 [4: 128] @ 0x50a1c5 0x51b02a 0x6c1436 0x473bae 0x473e37 0x6b52ab 0x473bae 0x473e37 0x6bacf2 0x6baad6 0x4ca485 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x50a1c4 os.NewSyscallError+0xb4 /usr/lib/go-1.10/src/os/error.go:62
# 0x50a1c4 net.wrapSyscallError+0xb4 /usr/lib/go-1.10/src/net/error_posix.go:18
# 0x50a1c4 net.(*netFD).Write+0xb4 /usr/lib/go-1.10/src/net/fd_unix.go:222
# 0x51b029 net.(*conn).Write+0x69 /usr/lib/go-1.10/src/net/net.go:188
# 0x6c1435 net/http.checkConnErrorWriter.Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:3313
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6b52aa net/http.(*chunkWriter).Write+0xaa /usr/lib/go-1.10/src/net/http/server.go:372
# 0x473bad bufio.(*Writer).Flush+0x7d /usr/lib/go-1.10/src/bufio/bufio.go:573
# 0x473e36 bufio.(*Writer).Write+0x106 /usr/lib/go-1.10/src/bufio/bufio.go:609
# 0x6bacf1 net/http.(*response).write+0x141 /usr/lib/go-1.10/src/net/http/server.go:1529
# 0x6baad5 net/http.(*response).Write+0x55 /usr/lib/go-1.10/src/net/http/server.go:1499
# 0x4ca484 fmt.Fprintf+0xa4 /usr/lib/go-1.10/src/fmt/print.go:189
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [5022: 80352] @ 0x7484c7 0x74b533 0x74b6a5 0x45b901
# 0x7484c6 github.com/google/mtail/vm.(*VM).execute+0x2186 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:564
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [317257: 91370016] @ 0x40d6fc 0x6eb02a 0x6eb154 0x45b901
# 0x6eb029 github.com/google/mtail/metrics.zip+0xb9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:168
# 0x6eb153 github.com/google/mtail/metrics.(*Metric).EmitLabelSets+0xc3 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:178
0: 0 [55006: 880096] @ 0x745e81 0x749d75 0x74b533 0x74b6a5 0x45b901
# 0x745e80 github.com/google/mtail/vm.compare+0x990 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:366
# 0x749d74 github.com/google/mtail/vm.(*VM).execute+0x3a34 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:444
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [323: 1323008] @ 0x464403 0x464316 0x46401f 0x4c9f51 0x4ca5c6 0x4ca6e7 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x46401e sync.(*Pool).Get+0x2e /usr/lib/go-1.10/src/sync/pool.go:128
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca5c5 fmt.Sprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:202
# 0x4ca6e6 fmt.Errorf+0x56 /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [92434: 1478944] @ 0x74aaed 0x74b533 0x74b6a5 0x45b901
# 0x74aaec github.com/google/mtail/vm.(*VM).execute+0x47ac /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:547
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [2: 32] @ 0x4d2093 0x4ca452 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d2092 fmt.(*buffer).WriteString+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:82
# 0x4d2092 fmt.(*pp).doPrintf+0x10f2 /usr/lib/go-1.10/src/fmt/print.go:964
# 0x4ca451 fmt.Fprintf+0x71 /usr/lib/go-1.10/src/fmt/print.go:188
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [30077: 1924928] @ 0x74a879 0x74b533 0x74b6a5 0x45b901
# 0x74a878 github.com/google/mtail/vm.(*thread).Push+0x4538 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:192
# 0x74a878 github.com/google/mtail/vm.(*VM).execute+0x4538 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:551
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [42044: 5381632] @ 0x4df36d 0x6ef1a6 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4df36c strings.Join+0xac /usr/lib/go-1.10/src/strings/strings.go:435
# 0x6ef1a5 github.com/google/mtail/exporter.metricToPrometheus+0x325 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:76
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [200406: 41684448] @ 0x4aae61 0x4aa83d 0x6f399f 0x6f32d4 0x45b901
# 0x4aae60 os.lstatNolog+0x30 /usr/lib/go-1.10/src/os/stat_unix.go:41
# 0x4aa83c os.Lstat+0x4c /usr/lib/go-1.10/src/os/stat.go:22
# 0x6f399e github.com/fsnotify/fsnotify.(*Event).ignoreLinux+0x6e /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:312
# 0x6f32d3 github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x4b3 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:283
0: 0 [15380: 246080] @ 0x6f4b65 0x45b901
# 0x6f4b64 github.com/google/mtail/watcher.(*LogWatcher).run+0x1c4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/watcher/log_watcher.go:69
0: 0 [60740: 7774720] @ 0x7104f1 0x749859 0x74b533 0x74b6a5 0x45b901
# 0x7104f0 regexp.(*Regexp).FindStringSubmatch+0x100 /usr/lib/go-1.10/src/regexp/regexp.go:950
# 0x749858 github.com/google/mtail/vm.(*VM).execute+0x3518 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:427
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [340697: 21804608] @ 0x7464c2 0x74b533 0x74b6a5 0x45b901
# 0x7464c1 github.com/google/mtail/vm.(*VM).execute+0x181 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:635
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [15081: 241296] @ 0x717700 0x719cc5 0x45b901
# 0x7176ff github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x7f /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:171
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [1: 32] @ 0x463f58 0x4ca06e 0x4ca4b1 0x6eebce 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x463f57 sync.(*Pool).Put+0x127 /usr/lib/go-1.10/src/sync/pool.go:108
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca4b0 fmt.Fprintf+0xd0 /usr/lib/go-1.10/src/fmt/print.go:190
# 0x6eebcd github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x3ad /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:54
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [137680: 39651840] @ 0x40cf97 0x7498ae 0x74b533 0x74b6a5 0x45b901
# 0x7498ad github.com/google/mtail/vm.(*VM).execute+0x356d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:427
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [1: 4096] @ 0x464403 0x464316 0x463e6d 0x4ca06e 0x4ca654 0x6e7bda 0x6ef1da 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca653 fmt.Sprintf+0xb3 /usr/lib/go-1.10/src/fmt/print.go:205
# 0x6e7bd9 github.com/google/mtail/metrics/datum.(*IntDatum).ValueString+0x99 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/datum/int.go:43
# 0x6ef1d9 github.com/google/mtail/exporter.metricToPrometheus+0x359 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:77
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [100961: 20999888] @ 0x4aaadf 0x717a98 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x4aaade os.(*File).Stat+0x3e /usr/lib/go-1.10/src/os/stat_unix.go:19
# 0x717a97 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0x77 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:199
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [60251: 7712128] @ 0x7467e4 0x74b533 0x74b6a5 0x45b901
# 0x7467e3 github.com/google/mtail/vm.(*thread).Push+0x4a3 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:192
# 0x7467e3 github.com/google/mtail/vm.(*VM).execute+0x4a3 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:627
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [2: 8192] @ 0x464403 0x464316 0x463e6d 0x4ca06e 0x4ca654 0x6ef38d 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x464402 sync.(*Pool).pinSlow+0xc2 /usr/lib/go-1.10/src/sync/pool.go:212
# 0x464315 sync.(*Pool).pin+0x55 /usr/lib/go-1.10/src/sync/pool.go:191
# 0x463e6c sync.(*Pool).Put+0x3c /usr/lib/go-1.10/src/sync/pool.go:100
# 0x4ca06d fmt.(*pp).free+0x8d /usr/lib/go-1.10/src/fmt/print.go:145
# 0x4ca653 fmt.Sprintf+0xb3 /usr/lib/go-1.10/src/fmt/print.go:205
# 0x6ef38c github.com/google/mtail/exporter.metricToPrometheus+0x50c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:72
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [60203: 7705984] @ 0x70a402 0x7104a5 0x749859 0x74b533 0x74b6a5 0x45b901
# 0x70a401 regexp.(*Regexp).doExecute+0x271 /usr/lib/go-1.10/src/regexp/exec.go:451
# 0x7104a4 regexp.(*Regexp).FindStringSubmatch+0xb4 /usr/lib/go-1.10/src/regexp/regexp.go:946
# 0x749858 github.com/google/mtail/vm.(*VM).execute+0x3518 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:427
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [7724: 123584] @ 0x4ca70b 0x717ae9 0x717f3c 0x71786a 0x719cc5 0x45b901
# 0x4ca70a errors.New+0x7a /usr/lib/go-1.10/src/errors/errors.go:10
# 0x4ca70a fmt.Errorf+0x7a /usr/lib/go-1.10/src/fmt/print.go:212
# 0x717ae8 github.com/google/mtail/tailer.(*Tailer).handleTruncate+0xc8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:205
# 0x717f3b github.com/google/mtail/tailer.(*Tailer).read+0x3ab /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:225
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [1: 96] @ 0x42e9b2 0x405f53 0x405d7b 0x719b56 0x45b901
# 0x719b55 github.com/google/mtail/tailer.(*Tailer).run+0x65 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:425
0: 0 [1: 192] @ 0x4d71dd 0x46409b 0x4c9f51 0x4ca5c6 0x6ef38d 0x6ee98d 0x7546d8 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x4d71dc fmt.glob..func1+0x2c /usr/lib/go-1.10/src/fmt/print.go:128
# 0x46409a sync.(*Pool).Get+0xaa /usr/lib/go-1.10/src/sync/pool.go:151
# 0x4c9f50 fmt.newPrinter+0x30 /usr/lib/go-1.10/src/fmt/print.go:133
# 0x4ca5c5 fmt.Sprintf+0x25 /usr/lib/go-1.10/src/fmt/print.go:202
# 0x6ef38c github.com/google/mtail/exporter.metricToPrometheus+0x50c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:72
# 0x6ee98c github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics+0x16c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/exporter/prometheus.go:56
# 0x7546d7 github.com/google/mtail/exporter.(*Exporter).HandlePrometheusMetrics-fm+0x47 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:210
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 1536] @ 0x46e83d 0x46e1f1 0x46e658 0x5691d5 0x5693c5 0x75e1f6 0x75d795 0x757918 0x75a34b 0x75a0b0 0x756bf4 0x7623bd 0x762741 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x46e83c bytes.makeSlice+0x6c /usr/lib/go-1.10/src/bytes/buffer.go:230
# 0x46e1f0 bytes.(*Buffer).grow+0x150 /usr/lib/go-1.10/src/bytes/buffer.go:144
# 0x46e657 bytes.(*Buffer).ReadFrom+0x47 /usr/lib/go-1.10/src/bytes/buffer.go:204
# 0x5691d4 io/ioutil.readAll+0xb4 /usr/lib/go-1.10/src/io/ioutil/ioutil.go:36
# 0x5693c4 io/ioutil.ReadFile+0xd4 /usr/lib/go-1.10/src/io/ioutil/ioutil.go:73
# 0x75e1f5 runtime/pprof.(*profileBuilder).readMapping+0x35 /usr/lib/go-1.10/src/runtime/pprof/proto.go:406
# 0x75d794 runtime/pprof.newProfileBuilder+0x214 /usr/lib/go-1.10/src/runtime/pprof/proto.go:279
# 0x757917 runtime/pprof.printCountProfile+0x817 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:426
# 0x75a34a runtime/pprof.writeRuntimeProfile+0x13a /usr/lib/go-1.10/src/runtime/pprof/pprof.go:687
# 0x75a0af runtime/pprof.writeGoroutine+0x9f /usr/lib/go-1.10/src/runtime/pprof/pprof.go:641
# 0x756bf3 runtime/pprof.(*Profile).WriteTo+0x3e3 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:310
# 0x7623bc net/http/pprof.handler.ServeHTTP+0x20c /usr/lib/go-1.10/src/net/http/pprof/pprof.go:243
# 0x762740 net/http/pprof.Index+0x1d0 /usr/lib/go-1.10/src/net/http/pprof/pprof.go:254
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [46350: 2224800] @ 0x4849d6 0x484a95 0x4895b9 0x4aae8c 0x4aa83d 0x6f399f 0x6f32d4 0x45b901
# 0x4849d5 syscall.ByteSliceFromString+0x95 /usr/lib/go-1.10/src/syscall/syscall.go:56
# 0x484a94 syscall.BytePtrFromString+0x34 /usr/lib/go-1.10/src/syscall/syscall.go:72
# 0x4895b8 syscall.Lstat+0x38 /usr/lib/go-1.10/src/syscall/zsyscall_linux_amd64.go:1308
# 0x4aae8b os.lstatNolog+0x5b /usr/lib/go-1.10/src/os/stat_unix.go:42
# 0x4aa83c os.Lstat+0x4c /usr/lib/go-1.10/src/os/stat.go:22
# 0x6f399e github.com/fsnotify/fsnotify.(*Event).ignoreLinux+0x6e /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:312
# 0x6f32d3 github.com/fsnotify/fsnotify.(*Watcher).readEvents+0x4b3 /build/mtail-3.0.0~rc5/build/src/github.com/fsnotify/fsnotify/inotify.go:283
0: 0 [3912050: 16023756800] @ 0x717be1 0x71786a 0x719cc5 0x45b901
# 0x717be0 github.com/google/mtail/tailer.(*Tailer).read+0x50 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:216
# 0x717869 github.com/google/mtail/tailer.(*Tailer).handleLogUpdate+0x1e9 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:183
# 0x719cc4 github.com/google/mtail/tailer.(*Tailer).run+0x1d4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/tailer/tail.go:429
0: 0 [52688: 2529024] @ 0x408f3d 0x6eaf96 0x6eb154 0x45b901
# 0x6eaf95 github.com/google/mtail/metrics.zip+0x25 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:166
# 0x6eb153 github.com/google/mtail/metrics.(*Metric).EmitLabelSets+0xc3 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/metrics/metric.go:178
0: 0 [481017: 7696272] @ 0x74a9ae 0x74b533 0x74b6a5 0x45b901
# 0x74a9ad github.com/google/mtail/vm.(*VM).execute+0x466d /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:543
# 0x74b532 github.com/google/mtail/vm.(*VM).processLine+0x152 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:756
# 0x74b6a4 github.com/google/mtail/vm.(*VM).Run+0xf4 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/vm.go:774
0: 0 [1: 663552] @ 0x655c41 0x660711 0x75dfff 0x757c93 0x75a34b 0x75a0b0 0x756bf4 0x7623bd 0x762741 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x655c40 compress/flate.NewWriter+0x30 /usr/lib/go-1.10/src/compress/flate/deflate.go:667
# 0x660710 compress/gzip.(*Writer).Write+0x3b0 /usr/lib/go-1.10/src/compress/gzip/gzip.go:191
# 0x75dffe runtime/pprof.(*profileBuilder).build+0x3ee /usr/lib/go-1.10/src/runtime/pprof/proto.go:397
# 0x757c92 runtime/pprof.printCountProfile+0xb92 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:447
# 0x75a34a runtime/pprof.writeRuntimeProfile+0x13a /usr/lib/go-1.10/src/runtime/pprof/pprof.go:687
# 0x75a0af runtime/pprof.writeGoroutine+0x9f /usr/lib/go-1.10/src/runtime/pprof/pprof.go:641
# 0x756bf3 runtime/pprof.(*Profile).WriteTo+0x3e3 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:310
# 0x7623bc net/http/pprof.handler.ServeHTTP+0x20c /usr/lib/go-1.10/src/net/http/pprof/pprof.go:243
# 0x762740 net/http/pprof.Index+0x1d0 /usr/lib/go-1.10/src/net/http/pprof/pprof.go:254
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 48] @ 0x72f4a6 0x7326c1 0x72f2fb 0x72deb7 0x7364d6 0x73e307 0x7366f8 0x72d9cc 0x72d3dc 0x734419 0x733a6d 0x73349a 0x7531e9 0x753812 0x763538 0x42e1b2 0x45b901
# 0x72f4a5 github.com/google/mtail/vm.(*lexer).emit+0x125 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/lexer.go:179
# 0x7326c0 github.com/google/mtail/vm.lexCapref+0x190 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/lexer.go:519
# 0x72f2fa github.com/google/mtail/vm.(*lexer).nextToken+0xaa /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/lexer.go:171
# 0x72deb6 github.com/google/mtail/vm.(*parser).Lex+0x46 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/driver.go:48
# 0x7364d5 github.com/google/mtail/vm.mtaillex1+0x55 yaccpar:119
# 0x73e306 github.com/google/mtail/vm.(*mtailParserImpl).Parse+0x7be6 yaccpar:204
# 0x7366f7 github.com/google/mtail/vm.mtailParse+0x57 yaccpar:153
# 0x72d9cb github.com/google/mtail/vm.Parse+0x6b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/driver.go:17
# 0x72d3db github.com/google/mtail/vm.Compile+0x8b /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/compiler.go:32
# 0x734418 github.com/google/mtail/vm.(*Loader).CompileAndRun+0xd8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:178
# 0x733a6c github.com/google/mtail/vm.(*Loader).LoadProg+0x28c /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:113
# 0x733499 github.com/google/mtail/vm.(*Loader).LoadProgs+0x309 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/vm/loader.go:71
# 0x7531e8 github.com/google/mtail/mtail.(*MtailServer).InitLoader+0x1c8 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:95
# 0x753811 github.com/google/mtail/mtail.New+0xf1 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/mtail/mtail.go:180
# 0x763537 main.main+0x487 /build/mtail-3.0.0~rc5/build/src/github.com/google/mtail/main.go:140
# 0x42e1b1 runtime.main+0x211 /usr/lib/go-1.10/src/runtime/proc.go:198
0: 0 [1: 139264] @ 0x6552ec 0x655c72 0x660711 0x75dfff 0x757c93 0x75a34b 0x75a0b0 0x756bf4 0x7623bd 0x762741 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x6552eb compress/flate.newDeflateFast+0x51b /usr/lib/go-1.10/src/compress/flate/deflatefast.go:55
# 0x6552eb compress/flate.(*compressor).init+0x51b /usr/lib/go-1.10/src/compress/flate/deflate.go:592
# 0x655c71 compress/flate.NewWriter+0x61 /usr/lib/go-1.10/src/compress/flate/deflate.go:668
# 0x660710 compress/gzip.(*Writer).Write+0x3b0 /usr/lib/go-1.10/src/compress/gzip/gzip.go:191
# 0x75dffe runtime/pprof.(*profileBuilder).build+0x3ee /usr/lib/go-1.10/src/runtime/pprof/proto.go:397
# 0x757c92 runtime/pprof.printCountProfile+0xb92 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:447
# 0x75a34a runtime/pprof.writeRuntimeProfile+0x13a /usr/lib/go-1.10/src/runtime/pprof/pprof.go:687
# 0x75a0af runtime/pprof.writeGoroutine+0x9f /usr/lib/go-1.10/src/runtime/pprof/pprof.go:641
# 0x756bf3 runtime/pprof.(*Profile).WriteTo+0x3e3 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:310
# 0x7623bc net/http/pprof.handler.ServeHTTP+0x20c /usr/lib/go-1.10/src/net/http/pprof/pprof.go:243
# 0x762740 net/http/pprof.Index+0x1d0 /usr/lib/go-1.10/src/net/http/pprof/pprof.go:254
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
0: 0 [1: 262144] @ 0x655369 0x655c72 0x660711 0x75dfff 0x757c93 0x75a34b 0x75a0b0 0x756bf4 0x7623bd 0x762741 0x6bcc14 0x6be880 0x6bf92c 0x6bbc31 0x45b901
# 0x655368 compress/flate.(*compressor).init+0x598 /usr/lib/go-1.10/src/compress/flate/deflate.go:593
# 0x655c71 compress/flate.NewWriter+0x61 /usr/lib/go-1.10/src/compress/flate/deflate.go:668
# 0x660710 compress/gzip.(*Writer).Write+0x3b0 /usr/lib/go-1.10/src/compress/gzip/gzip.go:191
# 0x75dffe runtime/pprof.(*profileBuilder).build+0x3ee /usr/lib/go-1.10/src/runtime/pprof/proto.go:397
# 0x757c92 runtime/pprof.printCountProfile+0xb92 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:447
# 0x75a34a runtime/pprof.writeRuntimeProfile+0x13a /usr/lib/go-1.10/src/runtime/pprof/pprof.go:687
# 0x75a0af runtime/pprof.writeGoroutine+0x9f /usr/lib/go-1.10/src/runtime/pprof/pprof.go:641
# 0x756bf3 runtime/pprof.(*Profile).WriteTo+0x3e3 /usr/lib/go-1.10/src/runtime/pprof/pprof.go:310
# 0x7623bc net/http/pprof.handler.ServeHTTP+0x20c /usr/lib/go-1.10/src/net/http/pprof/pprof.go:243
# 0x762740 net/http/pprof.Index+0x1d0 /usr/lib/go-1.10/src/net/http/pprof/pprof.go:254
# 0x6bcc13 net/http.HandlerFunc.ServeHTTP+0x43 /usr/lib/go-1.10/src/net/http/server.go:1947
# 0x6be87f net/http.(*ServeMux).ServeHTTP+0x12f /usr/lib/go-1.10/src/net/http/server.go:2337
# 0x6bf92b net/http.serverHandler.ServeHTTP+0xbb /usr/lib/go-1.10/src/net/http/server.go:2694
# 0x6bbc30 net/http.(*conn).serve+0x650 /usr/lib/go-1.10/src/net/http/server.go:1830
# runtime.MemStats
# Alloc = 2359613912
# TotalAlloc = 3988508559448
# Sys = 2675182200
# Lookups = 656346
# Mallocs = 52197808595
# Frees = 52193326956
# HeapAlloc = 2359613912
# HeapSys = 2526052352
# HeapIdle = 111525888
# HeapInuse = 2414526464
# HeapReleased = 48283648
# HeapObjects = 4481639
# Stack = 4947968 / 4947968
# MSpan = 39194264 / 40042496
# MCache = 55552 / 65536
# BuckHashSys = 1511639
# GCSys = 91348992
# OtherSys = 11213217
# NextGC = 4719039408
# LastGC = 1575551236519684600
# PauseNs = [250383 267745 256144 245866 255738 356815 244717 242587 289589 277149 214804 281150 208246 227509 274132 194483 275107 253175 247111 284724 211752 303753 207348 200238 252548 383387 262161 198771 237375 261739 220980 234154 237001 263654 251842 338169 256050 248131 204273 198303 222411 574776 328540 248788 289032 290744 247712 195812 2075396 268006 221826 191063 297797 214857 222816 234369 278578 220425 314300 315011 243186 199323 251053 318431 198869 252124 206803 250828 228584 347697 239391 227909 222896 221008 257198 242152 296495 295816 194750 251813 212206 210430 212676 242996 635384 229753 213526 225915 238212 241000 355429 239755 263611 253247 253070 283282 234775 249433 272911 235589 281464 2572362 199221 194896 230219 331891 256413 286244 210978 260118 202277 260677 265352 243416 230575 358315 239235 345863 276410 283944 222633 291139 261669 238455 243958 236763 314568 346082 193599 237964 202607 299463 306087 230734 220343 248888 200722 234894 376890 296041 296903 187927 190004 207523 235063 269717 432242 180568 318464 256052 239207 265515 186000 311350 231780 209007 231631 230214 200416 280298 350240 275798 230795 212735 224864 263772 264866 311240 214134 202083 325995 246048 345673 227200 197984 235283 246083 238630 216963 291335 329479 212878 211238 256770 199508 247042 217619 309128 254875 302452 214587 220289 222051 346864 248932 340396 208909 199798 261750 208280 341187 220154 204883 216854 208467 240524 261037 239500 340354 206822 217897 207174 205916 226425 292820 299418 262073 265738 264905 217860 232794 306084 243498 217793 241580 245636 261749 216927 272871 236967 242490 197260 238815 328709 227582 250152 267651 202649 212045 196254 225122 385755 287604 188177 198240 280573 260377 1173469 211373 304964 231936 210374 248913 281325 267575 242226]
# PauseEnd = [1575529742751112045 1575529864464724069 1575529994474596296 1575530132771349038 1575530282750335753 1575530404449472261 1575530534464260491 1575530672740731888 1575530822755827961 1575530944441688917 1575531074462341266 1575531212760172015 1575531362734494638 1575531484444689595 1575531614457403358 1575531752746058432 1575531902753370591 1575532024453853304 1575532154444855001 1575532292747604588 1575532442758070359 1575532564456330405 1575532694447550517 1575532832758239132 1575532982749237067 1575533104440441363 1575533234467172160 1575533372753631666 1575533522753587443 1575533644451308139 1575533774445513048 1575533912747243950 1575534062760218825 1575534184491003047 1575534314462118535 1575534452750392860 1575534602747906346 1575534724458380128 1575534854439514166 1575534992770858406 1575535142749837111 1575535264461287774 1575535394503698020 1575535532746109841 1575535682746792686 1575535804454938363 1575535934443639546 1575536072739554270 1575536221636350636 1575536342736143875 1575536464463628221 1575536594452892567 1575536732777870263 1575536882745202987 1575537004447613993 1575537134466177175 1575537272758002316 1575537422759858835 1575537544458566778 1575537674465243885 1575537812775963716 1575537962776395635 1575538084455802407 1575538214446313986 1575538352751589113 1575538502738952091 1575538624452409876 1575538754442023728 1575538892732123030 1575539035588008190 1575539162748051918 1575539284451313144 1575539414446284126 1575539552763250102 1575539702752327348 1575539824457212959 1575539954450421642 1575540092753268305 1575540242750844355 1575540364456577896 1575540494458217421 1575540632747289360 1575540782766127633 1575540904462121636 1575541034480548548 1575541172761427502 1575541322757672534 1575541444454010752 1575541574453715765 1575541712753024790 1575541849533287266 1575541982745389935 1575542104450806393 1575542234456998785 1575542372737693871 1575542522743126634 1575542644456881185 1575542774462115384 1575542912737507970 1575543062759230673 1575543184462789470 1575543314488830695 1575543452746949803 1575543602746466271 1575543724453386888 1575543854448773696 1575543992747862323 1575544142751138746 1575544264458428069 1575544394451520491 1575544532758035664 1575544663491600072 1575544802757439125 1575544924456041606 1575545054450164992 1575545192773067640 1575545342755254453 1575545464452295969 1575545594444176624 1575545732749945746 1575545882752955102 1575546004465537348 1575546134480287754 1575546272754116435 1575546422749631499 1575546544464540269 1575546674466406687 1575546812786582493 1575546962747322690 1575547084459133141 1575547214455090145 1575547352784521291 1575547477466695372 1575547622764396896 1575547744463448801 1575547874455218643 1575548012742376656 1575548162745509854 1575548284635704252 1575548414467204911 1575548552752070869 1575548702765163917 1575548824473708934 1575548954464304364 1575549092753319553 1575549242757574151 1575549364460238457 1575549494449711670 1575549632766800280 1575549782746390721 1575549904457283929 1575550034462298086 1575550172750361244 1575550322746052469 1575550444472961573 1575550574457470407 1575550712766898536 1575550862821665647 1575550984451930572 1575551112963387010 1575551236519684600 1575516914460870384 1575517052748868509 1575517202754523987 1575517324442225347 1575517454451711656 1575517592744563205 1575517742738649780 1575517864466553297 1575517994464523235 1575518132748023944 1575518282758932026 1575518404452163862 1575518534451075147 1575518672732663953 1575518822741124543 1575518944469343152 1575519074442143379 1575519212747584487 1575519337915496616 1575519482752926995 1575519604448918700 1575519734456181036 1575519872755038254 1575520022760171393 1575520144461381054 1575520274450395265 1575520412753363914 1575520562756469059 1575520684436326077 1575520814456529216 1575520952734868313 1575521102745034320 1575521224456973129 1575521354450710725 1575521492728372880 1575521642743179024 1575521764441519443 1575521894450084758 1575522032749534628 1575522182749583526 1575522304455307891 1575522434453791127 1575522572751231454 1575522722744434806 1575522844446119647 1575522974448840759 1575523112741902110 1575523262774606681 1575523384441887248 1575523514481897029 1575523652734540683 1575523802741732514 1575523924439680282 1575524054448521934 1575524192740416107 1575524342769476285 1575524464455136662 1575524594458631838 1575524732739240457 1575524882740939897 1575525004444808335 1575525134443310955 1575525272743274747 1575525422734766905 1575525544450820377 1575525674453804851 1575525812763278183 1575525962762980843 1575526084463661512 1575526214452553614 1575526352745174099 1575526502746485607 1575526624460850750 1575526754464981037 1575526892746210558 1575527042752432785 1575527164459611525 1575527294454861370 1575527432742522883 1575527582751089404 1575527704473903788 1575527834458826878 1575527972750701898 1575528122743056299 1575528244447824243 1575528374450609175 1575528512768802092 1575528662760058379 1575528784472005559 1575528914466415552 1575529052744368670 1575529202751299806 1575529324458466577 1575529454452583791 1575529592741799046]
# NumGC = 91041
# NumForcedGC = 0
# GCCPUFraction = 0.00017083098611026353
# DebugGC = false
--- mutex:
cycles/second=2500025161
sampling period=0
threadcreate profile: total 72
71 @
# 0x0
1 @ 0x43199c 0x4320a9 0x43236f 0x42e141 0x45b901
# 0x43199b runtime.allocm+0x15b /usr/lib/go-1.10/src/runtime/proc.go:1516
# 0x4320a8 runtime.newm+0x38 /usr/lib/go-1.10/src/runtime/proc.go:1830
# 0x43236e runtime.startTemplateThread+0x4e /usr/lib/go-1.10/src/runtime/proc.go:1891
# 0x42e140 runtime.main+0x1a0 /usr/lib/go-1.10/src/runtime/proc.go:181
Event Timeline
ProdPasteBot
edited the content of this paste.
(Show Details)
Dec 5 2019, 1:24 PM
2019-12-05 13:24:44 (UTC+0)
ProdPasteBot
changed the title of this paste from untitled to
Masterwork From Distant Lands
.
fgiunchedi
archived this paste.
Dec 5 2019, 1:25 PM
2019-12-05 13:25:12 (UTC+0)
Log In to Comment