Position: Azure Data Engineer Location: NJ (Remote) MOI: Phone + Video Skills required Note: Must have hands-on experience on creating Data Catatlog and Unity Catalog process.
Experience building complex, highly scalable and reliable data pipelines using technologies like
Databricks, spark, Kafka, Hive, Parquet, Avro
Software development experience with High level languages like Python, Scala, Java, SQL, No-SQL
Experience working with pipeline orchestration tools to automate data flows like Azure Data Factory,
Airflow, Perfect
Experienced in Establishing and promoting high standards in DevOps, Security, CI/CD, Monitoring, data
validation, testing
Experience with cloud platforms (preferably Azure) and experience building enterprise level data lakes
Experience working with Terraform
Experience using Docker and Kubernetes
Experience with Microservices and RESTful APIs
Understanding Data Catalog, Data Governance, Data Lineage
Experience with integration of data from multiple data sources
SYSMIND LLC is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without any discrimination. We promote and support a diverse workforce at all levels in the company. All job offers are contingent upon completion of a satisfactory background check and reference checks. Additionally passing the drug test may also be required. All contractors intending to work on SYSMIND's W2 are "at will" employees.
