When I hear the Kafka community, I think about engineering talk more than anything else
When I hear the Kafka community, I think about engineering talk more than anything else
I'm of the opinion we're bound to see consolidation in the space soon, because there's too many companies chasing too little of a market: bigdata.2minutestreaming.com/p/event-stre...
I'm of the opinion we're bound to see consolidation in the space soon, because there's too many companies chasing too little of a market: bigdata.2minutestreaming.com/p/event-stre...
My intuition is rather that discussion has somewhat died down, in general.
My intuition is rather that discussion has somewhat died down, in general.
pgmq is not based on top of SQS. It only provides API parity with it. No messages actually go to SQS...
Latency-wise, my tests showed single-digit write and read. 99% use cases don't need less.
pgmq is not based on top of SQS. It only provides API parity with it. No messages actually go to SQS...
Latency-wise, my tests showed single-digit write and read. 99% use cases don't need less.
> move data fairly, fast, and reliably
It is fast. It is reliable.
It is not fair (the simple implementation).
Is fairness the missing piece?
(Just want to streamline the discussion)
> move data fairly, fast, and reliably
It is fast. It is reliable.
It is not fair (the simple implementation).
Is fairness the missing piece?
(Just want to streamline the discussion)
I simply perceived your intro/outro belittling the Postgres argument to clickbait to reach front-page of HN as such, hence fought back.
I simply perceived your intro/outro belittling the Postgres argument to clickbait to reach front-page of HN as such, hence fought back.
So yeah, unless somebody builds the `pgmq` equivalent and makes it work nice enough, it would be extra work that probably isn't justified.
It strongly depends on how much of that "complicated system" you truly need though!
So yeah, unless somebody builds the `pgmq` equivalent and makes it work nice enough, it would be extra work that probably isn't justified.
It strongly depends on how much of that "complicated system" you truly need though!
We have to separate the two, though:
- queues exists in battle-tested libraries like pgmq and the older pgq
So this is already built. Unless you want complex routing a-la Rabbit, its fine to use Postgres!
We have to separate the two, though:
- queues exists in battle-tested libraries like pgmq and the older pgq
So this is already built. Unless you want complex routing a-la Rabbit, its fine to use Postgres!
I definitely agree with some points made there and remain reasonable - but I think that under my mentioned constraints, PG is likely the right choice
I posted a rebuttal here if you care enough to read github.com/gunnarmorlin...
I definitely agree with some points made there and remain reasonable - but I think that under my mentioned constraints, PG is likely the right choice
I posted a rebuttal here if you care enough to read github.com/gunnarmorlin...
In any case, I think one would need to expose some dumbed down API for pub-sub users to avoid them doing more than just using the pub-sub, at least in the apps.
In any case, I think one would need to expose some dumbed down API for pub-sub users to avoid them doing more than just using the pub-sub, at least in the apps.