Skip to content

Add: Stream-Stream Joins in Real-Time Mode — Ad Click Attribution demo - #99

Open
muralitalluri-db wants to merge 3 commits into
databricks-solutions:mainfrom
muralitalluri-db:rtm-streamStreamJoin-adClickAttribution
Open

Add: Stream-Stream Joins in Real-Time Mode — Ad Click Attribution demo#99
muralitalluri-db wants to merge 3 commits into
databricks-solutions:mainfrom
muralitalluri-db:rtm-streamStreamJoin-adClickAttribution

Conversation

@muralitalluri-db

Copy link
Copy Markdown

Adds a self-serve sample demonstrating stream-stream join support in Apache Spark Real-Time Mode (DBR 18+), using a real-time ad click attribution use case (impressions joined to clicks, inner time-bounded join). Includes a data generator + Delta replay harness (~30K events/sec), Kafka ingest notebooks, the RTM/MBM join notebook (only the trigger changes), optional Delta landing + debug.sql for latency percentiles, and a README. Workspace-specific values are left as placeholders. Companion blog URL is a TODO to add on publish.

@HeartSaVioR HeartSaVioR left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looked through RTM-SSJ.py as requested; looks OK to me, assuming @muralitalluri-db ran this manually to confirm the code. Let's just use a (couple) seconds or just 0 second for processing time trigger.

Comment thread 2026-08-rtm-streamStreamJoin-adClickAttribution/README.md Outdated
Comment thread 2026-08-rtm-streamStreamJoin-adClickAttribution/README.md Outdated
Comment thread 2026-08-rtm-streamStreamJoin-adClickAttribution/README.md Outdated
Comment thread 2026-08-rtm-streamStreamJoin-adClickAttribution/README.md Outdated
Comment thread 2026-08-rtm-streamStreamJoin-adClickAttribution/README.md
Comment thread 2026-08-rtm-streamStreamJoin-adClickAttribution/README.md Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants