guidok91/spark-structured-streaming-kafka

Spark Structured Streaming data pipeline that processes movie ratings data in real-time.

spark-structured-streaming-kafka's Issues

cannot run spark-submit

Hi, when i want to run the app

.PHONY:
streaming-app-run: # Run Spark Structured streaming app locally.
poetry run spark-submit
$(SPARK_ARGS)
movie_ratings_streaming/entrypoint.py

if get

Traceback (most recent call last):
File "C:\dev\spark-structured-streaming-kafka\movie_ratings_streaming\entrypoint.py", line 3, in
from movie_ratings_streaming.config.config import read_config, read_source_avro_schema
ModuleNotFoundError: No module named 'movie_ratings_streaming'

any idea ? the init.py in movie_ratings_streaming is there...