MinIO
Condense utilizes MinIO, an object storage solution similar to S3, for file-based operations. This includes:- Handling bulk data upload operations.
- Managing configuration files required by Condense modules.
Metering Service
Condense calculates and stores data ingestion charges based on user-configured dimensions. This service:- Tracks data volume ingested from mobility devices.
- Applies user-defined billing dimensions to calculate costs.
- Reports metering data to the Zeliot Central Tower daily, facilitating transparent billing.
Output Connector Services
Condense empowers users to define the destination for processed data. This can be:- A message queue for further processing in other systems.
- A database for long-term storage and analysis.
- Condense provides client libraries for various output connectors, allowing seamless data transfer based on user preferences.
Configuration Dashboards
Condense offers a user-friendly web interface for managing configurations. Users can:- Register and configure one or more Data sources for data ingestion.
- Select and configure data transformation modules (e.g., parsing, filtering).
- Define output connectors for processed data.
- Monitor data ingestion progress and view key metrics like data volume and throughput.
Release Management & Health Probes
Condense employs a dedicated service for managing deployments and monitoring system health. This service:- Deploys and manages Condense services based on user configurations and device types.
- Manages service upgrades as new releases become available.
- Runs health probes to monitor the performance and stability of Condense services.
- Reports service health metrics to the Zeliot Central Tower for centralized monitoring and anomaly detection.
- In case of anomalies, trigger alerts with relevant details to notify stakeholders for prompt action.