mtpatter/postgres-kafka-demo

Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.

postgres-kafka-demo's Issues

The RESEARCH_AVE_BOOST ksql does not return any results

I went through the entire example, until the end. I cross checked the creation of the table and data all through.

The only modification I had to do was the creation as below.

CREATE TABLE research_ave_boost WITH (KAFKA_TOPIC='research_ave_boost', VALUE_FORMAT='delimited') AS SELECT research, SUM(admit_chance)/COUNT(admit_chance) as ave_chance FROM research_boost GROUP BY research;

However this query in ksql does not return any results.

`SELECT "AVE_CHANCE" FROM "RESEARCH_AVE_BOOST"

WHERE cast("RESEARCH" as INT)=0;`

CREATE research_ave_boost not work

Hi,
Below syntax works (WITH statement)?
CREATE TABLE research_ave_boost AS
SELECT research, SUM(admit_chance)/COUNT(admit_chance) as ave_chance
FROM research_boost
WITH (KAFKA_TOPIC='research_ave_boost', VALUE_FORMAT='delimited', KEY='research')
GROUP BY research;
Thanks
Brad

Adding the sink connector to ksql table leads

All other CURL posts work. But this one does not.

curl -X POST -H "Accept:application/json" -H "Content-Type: application/json" \ --data @postgres-sink.json http://localhost:8083/connectors curl: (7) Failed to connect to localhost port 8083: Connection refused

Creating the Downstream table research_ave_boost did not work when using WITH

Thanks for an awesome tutorial. I am running into the following, when executing the creation of the Downstream table. Please see below.

Statement:CREATE TABLE research_ave_boost AS SELECT research, SUM(admit_chance)/COUNT(admit_chance) as ave_chance FROM research_boost WITH (KAFKA_TOPIC='research_ave_boost', VALUE_FORMAT='delimited', KEY='research') GROUP BY research; Caused by: line 1:140: mismatched input 'WITH' expecting ';' Caused by: org.antlr.v4.runtime.InputMismatchException