Accessing Your Molecule Data with Bigbang
Updated
by
Ken Maranian
Overview
Bigbang is Molecule’s data lake integration tool. It gives your team easy, secure access to your Molecule data in near-real-time, so you can power dashboards, build reports, or integrate with other systems.
There are two options to connect to your Molecule data.
Option 1: Molecule-Hosted Data Lake (Fully Managed)
Molecule will stream your data into a secure Postgres database we host and manage for you. You can connect to it using the tools your team already knows.
Best for: Teams who want fast access to Molecule data without managing infrastructure
Key Features:
- Real-time data sync from Molecule
- Connect with Metabase, PowerBI, Tableau, dbt, SQL, and more
- Easy setup and no infrastructure required on your end
- Molecule-managed security and monitoring
Option 2: Push to Your Data Lake (Customer-Managed)
Prefer to manage your own data lake? Bigbang can stream data to Confluent Kafka topics, which your team can sub-ribe to and load into your own data lake or warehouse.
Best for: Organizations with existing data platforms or custom reporting pipelines. How it works:
- Bigbang publishes Molecule data to Molecule hosted Kafka topics that contain only your data
- Molecule hosts the Kafka Connector Data Lake Connector (from the provided supported list of connectors)
- Your team hosts the Data Lake solution
- You ingest data into your own platforms in near real time
Supported targets include:
Database & Data Lake Connectors
- Snowflake Source & Sink
- Microsoft SQL Server Source, Sink, and CDC (Debezium V2)
- Oracle Database Source, Sink, and CDC
- PostgreSQL Source, Sink, and CDC (Debezium V2)
- MySQL Source CDC V2 (Debezium) & Sink
- Databricks Delta Lake Sink (for advanced analytics or ML pipelines)
- Amazon S3 Source
- Azure Blob Storage Source
- Google Cloud Storage Source
ETL / Data Pipeline & Integration
- HTTP Source & Sink
- SFTP Source & Sink
- RabbitMQ Source & Sink Connector
- IBM MQ Source
- Azure Event Hubs Source
- Azure Service Bus Source
- Amazon Kinesis Source
Source: Confluent Cloud Fully-Managed Managed Connectors | Confluent Documentation
Security & Access
- Each customer receives their own isolated data stream or database
- VPN access and IP whitelisting supported
- Molecule enforces strict access boundaries between customer environments
What You Can Do with Bigbang
- Build custom dashboards in Power BI or Tableau
- Run time-series and historical analysis not available via API
- Merge Molecule data with ERP, SCADA, credit, or treasury systems
- Automate internal reports for risk, operations, and compliance
Getting Started
Contact Molecule Support or your Customer Success Manager to enable Bigbang and choose your integration option.
Still Have Questions?
Reach out to your Molecule Account or Customer Success Manager or email: support@molecule.io
See related article: Getting Started with Bigbang
