Business applications systems analyst - Al Jubail, المملكة العربية السعودية - Nahdi Medical Pharmacies Company

وصف

This is a remote

The Jr Data Engineer at Koantek will have a working experience in languages like Python, SQL, Java/Scala or He/she will learn, get certified, and then use the knowledge of comprehensive modern data engineer techniques and methods with Advanced Analytics to support business decisions for our Your goal is to support the use of data-driven insights to help our clients achieve business outcomes and You will help design and build data pipelines, data streams, reporting tools, information dashboards, data service APIs, data generators, and other end-user information portals and insight You are expected to function as a productive member of a team, working and communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers.

Past job titles may have included: Python Developer, Java Developer, SQL Developer, Spark or Scala Developer

Requirements

Hands-on experience in one or more of languages like Python, Java, SQL, Spark/Scala, PySpark

Knowledge of different programming and scripting languages like .NET, PowerShell etc

Working knowledge of code versioning tools [such as Git, Bitbucket or SVN] is a plus

Working knowledge of/on different Operating Systems like Linux, Unix, Windows

Experience/Knowledge in creating tables, partitioning, bucketing, loading, and aggregating data using Spark SQL/PySpark

Working experience with Visual Studio, PowerShell Scripting, and ARM

Needs to be a flexible, capable, and fast learner

Knowledge of Azure DevOps processes like CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence

Knowledge of Stream Analytics, Event/IoT Hubs, and Cosmos

Knowledge of Azure cloud and Data Lake and Analytics solutions on

Knowledge of Spark Architecture including Spark Streaming, Spark Core, Spark SQL, Data Frames, RDD caching, Spark MLib

Knowledge of data frameworks, data lakes and open-source projects such as Apache Spark, MLflow, and Delta Lake

Knowledge of using Spark SQL with various data sources like JSON, Parquet and Key Value Pair

Knowledge of different data stores ( , Azure Data Lake GEN2, Azure SQL Data Warehouse, Azure Blob Storage, HDFS) , messaging systems ( , Azure Event Hubs, Apache Kafka), and data processing engines ( , Azure Data Lake Analytics, Apache Hadoop, Apache Spark, Apache Storm, Azure HDInsight)

Knowledge of Big Data/analytics/information analysis/database management in the cloud

Ability to remain up to date with industry standards and technological advancements that will enhance data quality and reliability to advance strategic initiatives

Basic experience with or knowledge of agile methodologies

Responsibilities:

· Learn and finish the assigned relevant training and get certified to become an Azure Databricks Engineer or an AWS Databricks Engineer

· Work closely with team members to learn, lead and drive enterprise solutions, advising on key decision points on trade-offs, best practices, and risk mitigation

· Prepare codes for all modules according to required specification

· Evaluate all functional requirements, map documents, and troubleshoot all development processes

· Document all technical specifications and associates project

· Design all test cases to provide support to all systems and perform unit

Qualifications:

0-2 years experience in a software development, data engineering, or data analytics field using Python, Scala, Spark, Java, or equivalent

Bachelor s or Master s degree in Big Data, Computer Science, Engineering, Mathematics, or similar area of study or equivalent work experience

Strong written and verbal communication skills

Ability to manage competing priorities in a fast-paced environment

Ability to resolve issues

Fast learner, Self-Motivated and ability to work independently