Back to all jobs

Senior Data Engineer for Ciklum Digital

Poland Remote

Big Data & Analytics

Description

On behalf of Ciklum Digital, Ciklum is looking for a Senior Data Engineer to join our team on a full-time basis.

You will join a highly motivated team and will be working on a modern solution for our existing client. We are looking for technology experts who want to make an impact on new business by applying best practices and taking ownership.

Project description:

In the project you will work with a bunch of clients, each has an integration system that is based on the Azure Services stack. Each integration has unique architecture, and it is a great opportunity to become acquainted with different approaches and best practices.

Technology Stack: 

Azure Services:

  • ADF
  • Azure SQL
  • Logic Apps
  • Function Apps
  • Application Services
  • Service Bus
  • Event Hub
  • Azure Databricks
  • Azure DevOps

 

Responsibilities

  • Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales
  • Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple data storages
  • Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed
  • Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
  • Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
  • Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
  • Contribute in CoE activities and community building, participate in conferences, provide excellence in exercise and best practices
  • Optimizing the architecture (Azure mandatory)
  • Monitoring and optimizing ETL processes (ADF mandatory), SQL database performance

Requirements

  • 3+ years of experience coding in SQL, Python, C#, with solid CS fundamentals including data structure and algorithm design
  • 1+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka
  • 1+ years of experience in Azure cloud data platform
  • Knowledge of professional software engineering best practices for the full software
  • Knowledge of Data Warehousing, design, implementation and optimization, strong in MSSQL, understanding DWH and Data Lake architecture
  • Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Demonstrated ability to learn new technologies quickly and independently
  • Ability to handle multiple competing priorities in a fast-paced environment
  • Solid knowledge in data integration / ETL projects
  • Experience using Data Factory
  • Understanding of big data processing
  • Power BI experience desirable

Desirable

  • Team Lead experience
  • Experience in Python
  • Experience in data science and machine learning
  • Experience in backend development and deployment
  • Experience in CI/CD configuration
  • Good knowledge of data analysis in enterprises

Personal skills

  • Collaborative, willing to help, talkative, able to clearly express and discuss ideas
  • Curious mind and willingness to work with client in consultative manner to find areas to improve
  • Upper-Intermediate or Advanced English
  • Good analytical skills
  • Good team player, motivated to develop and solve complex tasks
  • Self-motivated, self-disciplined and result oriented
  • Strong attention to details and accuracy

What's in it for you

  • A Centre of Excellence is ultimately a community that allows you to improve yourself and have fun. Our centres of excellence (CoE) bring together all Ciklumers from across the organization to share best practices, support, advice, industry knowledge and to create a strong community
  • Close cooperation with clients
  • Dynamic and challenging tasks
  • Ability to influence project technologies
  • Projects from scratch
  • Team of professionals: learn from colleagues and gain recognition of your skills
  • State of the art, cool, centrally located offices with warm atmosphere which creates really good working conditions Gdansk or Wroclaw
  • Work from home/100% remote
  • Private medical healthcare fully covered by Ciklum with a possibility to cover family members
  • Fully covered life insurance – 100 000 PLN
  • Fully covered drug insurance – up to 2 000 PLN/year
  • Multisport card 100% covered by Ciklum – Benefit Systems, Plus package
  • Parking space 50% covered by Ciklum

Your dream job isn’t here? Let’s stay in touch! We’ll inform you about the best opportunities.

    x

    filetypes: pdf | doc | docx limit - 1MB

    By submitting completed “Contact Us” form, your personal data will be processed by Ciklum Group and its subsidiary entities worldwide. Please read our Privacy Notice for more information. If you have any questions regarding your rights or would subsequently decide to withdraw your consent, please send your request to us.