Sintesys Outsourcing Strategy
We are looking for a Senior Software/Python Engineer for a position in NYC! These are the requirements:
- 10+ years of experience in software designing & development in production environments.
- Extensive experience with Python .
- Proven experience in designing & developing Python applications(backend) from scratch, extracting data using HTTP requests and working with complex JSON structures.
- Experience in designing, building, deploying into production using Big Data ecosystem like: Data Lakes, Data Pipelines , ETL - Batch and Real-Time Streaming.
- 3-5+ years of hands-on experience in Big Data Technologies – Pyspark, Hive, Spark SQL/DataFrames/DataSets, Kafka.
- Integrating PySpark with different data sources, example: parquet, json, csv, oracle, postgres, mysql, MS sqlserver etc.
- Performance Tuning techniques .
- Must have experience with AWS Cloud services like AWS (EMR, S3), AWS Lambda Framework & AWS CLI command.
- Experience using Airflow.
- EXCELLENT ENGLISH LEVEL
If you have all or most of the requirements, do not hesitate to send your resume! We want you in our team.