Get new jobs by email
- ...PySpark and SQL scripts to validate data pipelines, transformations, and integrations. Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards. Continuously...
- ...Data Factory Containerize applications using Docker, manage deployments with Helm, and run them on Kubernetes Implement modern storage solutions using open formats such as Parquet, Delta Lake, and Apache Iceberg Build high-performance analytics engines using...
- ...real-time data processing frameworks (Kafka, Flink, Spark Streaming). Experience with Azure ecosystem (Data Factory, Databricks, Storage, Synapse). Experience with CI/CD pipelines and automated testing workflows. Exposure to monitoring and alerting for data...