> ## Documentation Index > Fetch the complete documentation index at: https://docs.condense.io/llms.txt > Use this file to discover all available pages before exploring further. # Building Streaming Pipelines: With vs. Without Condense ## **Why is Condense the Best Way to Enable Agentic AI and Real-Time Data** | **WITHOUT CONDENSE** | **THE CONDENSE WAY** | | :----------------------------------------------------------------------------------------------------------- | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Coding Connectors Requires specialized Java/Scala skills to write and maintain industry specific connectors | Universal & Industry-Ready Connectors Deploy universal or specialized connectors (e.g., Telematics for Mobility) that come with built-in parsing for complex schemas | | Complex Management Development and maintenance of ever changing industry connectors becomes difficult | Configurable Output Sinks Configure and deploy pre-built sink/source connectors and through UI into the data pipeline | | Maintenance & Scalability Managing scale and failover of connectors become a challenge as the load increases | Elastic Scaling & High Availability Automatically scales connectors based on workload while ensuring fault tolerance, high availability, and uninterrupted data streaming. | | **WITHOUT CONDENSE** | **THE CONDENSE WAY** | | :---------------------------------------------------------------------------------------------------------------------------------------------- | :--------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Research & Glue Code Weeks spent finding libraries and writing boilerplate just to connect components | In-Built AI IDE & Git Sync Use purpose built AI agents to create, test, and build your custom transforms with GIT support. Publish them to be used in data pipeline directly | | Maintenance & Scalability Multiple workflows and automations are required to manage availability and failover of stream processing applications | Native Stream Processing No external engine needed. Deploy your custom logic as reusable connectors or transforms that runs as containerized services | | Disjointed Lifecycle Constant context switching between IDE, Git, Cloud Console, and CI/CD tools | Management & Scalability Complete lifecycle, versioning and scalability of services managed by Custom Transform Framework | | **WITHOUT CONDENSE** | **THE CONDENSE WAY** | | :--------------------------------------------------------------------------------------------------------------------------------------------------- | :------------------------------------------------------------------------------------------------------------------------------------------------- | | Absence of Insights Creation of observability layer based on disjointed CLI tools, multiple available monitoring stacks and manual log aggregation | Native Dashboard Built-in visual pipeline view to see data moving in real-time, Check and act based on states of services, logs and configurations | | Manual Tracking Manually monitoring usage, over-

provisioning, and under-utilization risks that impacts availability and increases operational cost | Comprehensive Observability Seamless integration with external tools industry accepted observability stacks for platform and cloud Ops | | Disjointed Lifecycle Constant context switching between IDE, Git, Cloud Console, and CI/CD tools |
Purpose Built AI Agents

Autonomously checks system to generate actionable insights | | **WITHOUT CONDENSE** | **THE CONDENSE WAY** | | :-------------------------------------------------------------------------------------------------------------------------------------- | :----------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Complex Setup Manual provisioning of Cloud compute resources and networking. Deployment of platform architecture for streaming usecases | Automated Provisioning Automated deployment of cloud resources and platform tailor-made for data streaming on your cloud subscription | | Maintenance Nightmare Difficult to manage uptime between Infra and other system upgrades and cross dependencies | Fully Managed Maintenance All upgrades, patches, and downtime recovery are handled by the Condense team. User stays on a stable interface with 99.95% availability | | Security Considerations Maintaining custom build governance workflows, cloud security and compliances becomes difficult over time | Security & Compliance Enterprise grade governance, audits, Information security and compliance certifications out-of-the-box | ## From Manual Workflows to Prompt-Driven Execution | **Before: Manual Data Streaming Stack** | **After: Condense with AI Agents** | | :------------------------------------------------------------------------------------------------------ | :------------------------------------------------------------------------------------------------------------ | | Create and manage Kafka topics manually | **VAPR (Supervisor Agent):** One interface to orchestrate all platform actions | | Write and debug stream processing logic | **Kafka Agent:** Create topics, read, and manage Kafka messages using natural language prompts | | Build microservices from scratch | **Developer Agent:** Generate production-ready microservices in minutes | | Manage deployments and scaling through DevOps | **Pipeline Agent:** Build and deploy complete streaming pipelines from a single prompt | | Orchestrate pipelines across multiple tools | **Kubernetes (K8s) Agent:** Monitor infrastructure, trigger deployments, and scale applications automatically | | Continuous coordination across development and operations teams | AI agents automate execution, reducing manual coordination and operational effort | | **Outcome:** Slow time to production, high operational overhead, heavy dependency on specialized skills | Outcome: Prompt-to-production in minutes, minimal manual effort, faster iteration, simplified operations |