CTO at Scalytics. I build distributed systems: streaming, IoT, data platforms and AI agent infrastructure. I live in Malta.
- Founder of Scalytics and of Infinite Devices (sold)
- Co-creator, committer and PMC member of Apache Wayang
- Author of KafScale
- Lead engineer and initiator of infinimesh
- Before that: Cloudera, Evariant, Google, Allianz and E.ON
I have written about this work on novatechflow.com since 2011, starting with Hadoop and moving through Kafka, IoT and agents. Most repos here started as a problem I hit in a real project. The blog explains the why, and the repo is the code.
- KafScale: Kafka-compatible streaming that keeps your data in S3. Code: KafScale/platform. Background: KafScale on novatechflow
- Lascaris: a sovereign AI agent platform on Kafka. Agents act on live data, and every decision is written to an audit log.
- KafClaw: an agent coordination framework for Kafka, written in Go. Docs: kafclaw.scalytics.io
- infinimesh: an open source IoT platform with a device registry, device shadow and MQTT bridge. Code: infinimesh/core. Read the infinimesh 3.4 release notes
- Apache Wayang: cross-platform data processing at the Apache Software Foundation
More open source from the Scalytics team: KafGraph (shared knowledge graph for agents), kafSIEM (entity graph over Kafka and OSINT feeds), kshark-core (Kafka connectivity diagnostics that agents can use to debug clusters), kaf-mirror (Kafka replication) and Scalytics Copilot (private AI inference). All of them are listed at scalytics.io/open-source.
| Repo | What it does | Read more |
|---|---|---|
| bacnet-mqtt-gateway | BACnet to MQTT gateway with REST API, web UI, bounded polling and writes | Connect BACnet to the cloud · BACnet MQTT in production |
| kaf-s3 | Kafka producer and consumer that offload large messages to S3, with integrity checks, DLQ and Prometheus metrics | Kafka-to-S3 connector case study |
| kaf-inspect | Kafka CLI to find duplicates, check consumer lag and grep messages | Kafka architecture guide |
| docai | Local-first OCR to Markdown to RAG toolkit | Use LLMs for PDF analysis |
| cerbtk | Proof of concept IoT device registry with signatures and an append-only log | IoT device manufacturing |
| lucendex | Non-custodial, deterministic routing engine for the XRPL DEX | lucendex.com |
| XRPayroll | Payroll proof of concept on the XRP Ledger, about 70% written with AI in December 2024 | Can AI really code? 2024 vs 2026 |
| polyDisplay | LAN dashboard for crypto and commodities, with optional Polymarket positions |
The older repos (Hive, Impala, Solr, FreeIPA, NiFi, OpenStack, from 2013 to 2016) are snippets from my Hadoop years. Most of them link to the matching post on the blog.
I help teams with streaming, IoT and AI agent architecture, from design to production. See consulting or book a call.
Blog · About · X @mapredit · LinkedIn · Scalytics