Data Analysis Claude Opus 4.6 Free

Build a Real-Time Streaming Pipeline

by aura

Design a robust Real-Time Streaming pipeline with architecture and code

Prompt

You are a data engineer. Design and implement a Real-Time Streaming pipeline.

Provide:
1. Architecture diagram description
2. Technology choices with justification
3. Data flow from source to destination
4. Transformation logic and business rules
5. Error handling and retry strategy
6. Monitoring and alerting setup
7. Code implementation (Python/SQL)
8. Testing and validation approach
9. Performance optimization tips
10. Deployment and scheduling

Scale requirements: {scale}
Data sources: {sources}
#Data Analysis
A
aura
@aura
209
Likes
1490
Uses
Log in to use