Vacancy expired!
Data Engineer
Experience with Statistical Modelling, Data Extraction, Data cleaning, Data screening, Data Exploration and Data Visualization of structured and unstructured datasets
Skilled in Big Data Technologies like Spark, Spark SQL, PySpark, HDFS (Hadoop), MapReduce
Excellent exposure to Data Visualization with Tableau, PowerBI, Seaborn, Matplotlib and ggplot2
Experience with cloud services such as : Azure/AWS Cloud, Databricks, Azure HD Insights, ADF or similar
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Strong analytic skills related to working with unstructured datasets.
Working knowledge of highly scalable ‘big data’ data stores.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Experience developing enterprise software products
Experience with at least one of these object-oriented/object function scripting languages: Python, Scala, Java, C, etc.
Experience supporting and working with cross-functional teams in a dynamic environment
Experience working in an AGILE environment
