Streaming Lead Events

Leandro
Leandro
  • Updated

Feature Snapshot

Summary:
Streaming Lead Events is a real‑time feature that automatically sends every event produced by your LeadConduit flow to external cloud storage—whether the lead is accepted, rejected, or halted by filters—ensuring complete, auditable records.

Key Benefits:

  • Retains a comprehensive audit trail by capturing both accepted and rejected lead event data
  • Supports robust compliance and quality control by preserving every processing step
  • Enables integration with external analytics tools for in‑depth performance analysis

Typical Use Cases:

  • Auditing and troubleshooting lead processing by reviewing complete event histories
  • Feeding lead event data into predictive models or data visualization dashboards
  • Maintaining regulatory compliance through complete data retention and traceability

How the Streaming Lead Events works?

Streaming Lead Events operates in the background by capturing the full JSON snapshot of each event as a lead flows through your LeadConduit process. Even when a filter stops a lead, all events processed up to that point—including submitted data, appended enrichment details, timestamps, and outcome statuses—are sent to your designated cloud storage. You can choose to stream these events either to an AWS S3 bucket or an Azure Blob container, ensuring that every detail is logged for later review and analysis.

Step‑by‑Step Instructions

  1. Open the Flow Editor:
    Log in to LeadConduit and navigate to the flow you wish to configure.

  2. Access the Event Streaming Menu:
    Click the Event Stream icon located in the upper right corner of the flow editor to open the Event Streaming configuration dialog.

  3. Prepare AWS / Azure Resources:
    Create an Amazon S3 bucket or Azure Blob Storage container and set up the required permissions by following AWS / Azure guidelines.

  4. Enter Credentials and Storage Details:
    Input your Amazon S3 bucket or Azure Blob Storage container AWS Access Key ID and Secret Access Key authentication details, specify the S3 bucket or Azure container name and a Prefix (folder path) to organize event files, and use the provided toggle to enable Event Streaming.

  5. Confirm and Save Configuration:
    Click the confirmation box and then save the flow. Once saved, every subsequent lead processed by the flow will have its event data streamed to the designated Amazon S3 bucket or Azure Blob Storage container.

Expected Result:
Every lead event, regardless of whether the lead is fully processed or halted early, will be delivered in real time to the specified Amazon S3 bucket or Azure Blob Storage container, ensuring a complete data record is available for review and analysis.

Event Stream configuration modal


Validation & Monitoring (optional)

  • Test the Setup: Submit a test lead through the configured flow and verify that an event file is generated in your Amazon S3 bucket or Azure Blob Storage container.
  • Where to Monitor?: Check the Amazon S3 bucket or Azure Blob Storage container dashboard for file uploads and review the LeadConduit Events tab to confirm that all expected events have been captured.

Best Practices

  • Regularly audit your Amazon S3 bucket or Azure Blob Storage container permissions and access policies to ensure secure access to event data.
  • Use clear, descriptive prefixes and folder structures in your Amazon S3 bucket or Azure Blob Storage container to organize event files by flow or time period.
  • Test Event Streaming with a low volume of leads before enabling it on high-traffic flows.
  • Monitor both AWS / Azure and LeadConduit dashboards to detect any discrepancies or delays in event delivery.
  • Update and rotate AWS / Azure credentials periodically to maintain security best practices.

Troubleshooting

Symptom / Error Likely Cause Resolution
No event files appearing in S3 or Azure Event Streaming may be disabled or misconfigured Revisit the Event Streaming configuration, ensure the toggle is enabled, and verify AWS / Azure credentials
Incomplete event data streamed Lead processing halted early generating partial events Check flow logs to confirm that even partial events are being generated and streamed correctly
Access Denied error when retrieving files Insufficient or incorrect IAM permissions for the S3 bucket Update IAM policies according to AWS guidelines to grant proper access to the S3 bucket

Frequently Asked Questions (FAQ)

What types of lead events are captured by Event Streaming?

Event Streaming captures every event generated during a lead’s journey—including full processing events, early rejections, and filter outcomes—ensuring a comprehensive record is maintained.

Why is event streaming important?

It is important because it allows you to audit and analyze every step of your lead flow in real time, provides the data needed for compliance and quality control, and enables seamless integration with external data analysis tools for improved decision-making.

Does enabling Event Streaming affect flow performance?

Event Streaming operates as a background process; while it runs continuously, its impact on flow performance is minimal. However, it is recommended to test with lower volumes initially to ensure system stability.

Do I need advanced AWS / Azure knowledge to set up Event Streaming?

A basic understanding of AWS / Azure —specifically how to create an S3 bucket or a Connection String and configure access permissions— is recommended. Detailed instructions and helpful links within LeadConduit guide you through the necessary steps.


Glossary

Term Definition
Event A recorded snapshot of a lead at a specific step in a flow, detailing submitted data, appended values, timestamps, and outcomes.
Event Streaming The real-time process of transmitting all lead event data from LeadConduit flows to an external Amazon S3 bucket for analysis.
S3 Bucket A scalable storage container provided by Amazon Web Services used to store files and data.
IAM AWS Identity and Access Management, a service that controls user access and permissions to AWS resources.
Blob Storage container A scalable storage container provided by Azure used to store files and data.
LeadConduit Flow A defined sequence of steps in LeadConduit used to process and evaluate submitted lead data.

Was this article helpful?

0 out of 0 found this helpful

Comments

0 comments

Please sign in to leave a comment.