Do you ever use the cursor to replay events? If so, have you hit any issues? I’ve seen the websocket stall for certain cursor ranges which is quite peculiar.

I’ve also seen the WS freeze (which would be fine if it weren’t for a bug in my implementation preventing resumption from working properly!)

this only seems to happen for certain cursor values - if I increase the value by a minute or so, the replay continues happily. is this something you've seen before, or is it likely that the issue is at my end?

what's going on here then?

It's not exactly "hands-on", but they recently put out a paper describing ClickHouse's architecture - it's pretty accessible and might be useful to you: www.vldb.org/pvldb/vol17/...

Oh, have just seen you're doing the very same, but better!

Bluesky has Alexey tech demo written all over it! I've started ingesting the Firehose into a ClickHouse instance. Very early days, but you can make some basic queries here: bluesky.joesstuff.co.uk if interested.

I will open source it (and improve visualisations) once I've tidied it up a bit...

hello, time traveller