Data Engineer

1 month ago

Vilnius, Lithuania Oxylabs Full time

We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone can grow and thrive.


Here's how our Data Team describes this position:


If you joined this team, you would be solving our clients’ most ambitious challenges - as we are reaching towards being one of the first data extraction services 


We value people hungry for knowledge and eager to apply it, and in return, we provide a constantly evolving environment rich with challenges that we solve with the latest technologies and greatest ideas. We have a seat ready for you


Your day-to-day:

Work with challenging tasks to maintain data that helps our clients gain insights on various aspects of our system.Work on our data platform to enable building and delivering large datasets to final clients.Collaborate with the back-end team to ensure smooth data pipelines and processing.Work with data extraction services and build tools for it.Build data models and implement necessary modifications.Understand big data processing principles.Design, implement, manage, test, monitor, and optimize our data platforms to meet the data pipeline needs.Identify incomplete data, improve the quality of data, and integrate data from several data sources.


Your skills & experience:

Experience building data pipelines using cloud service providers such as Amazon Web Services (AWS), Microsoft Azure or Google Cloud Platform (GCP).Strong experience using any of the cloud providers. We use GCP ideally would like GCP but AWS and Azure would be also valid.Experience with Apache Spark and/or its Python libraries.Knowledge of ETL/ELT pipeline design for semi-structured data (both batch and real-time), development and maintenance using SQL and/or Python.Experience with SQL and NoSQL approaches to database design for evolving schemas, preferably in context of a large data lake or data warehouse (e.g. Google Cloud Storage/Google BigQuery), optimized for either storage or retrieval.Experience setting up and maintaining scheduled data processing orchestration (e.g. Airflow, Dagster).Experience developing and maintaining the infrastructure and tools around the data pipeline is highly desirable (e.g. managing AWS resources via Terraform, setting up CI/CD, maintaining a Kubernetes cluster).
NICE TO HAVE:Experience working with dbt and Great Expectations is a plus.Experience working with or implementing Data Catalogs is a plus.Experience with REST API development is a plus.Experience with any of the messaging systems (such as Pub/Sub, RabbitMQ, AWS Kinesis or Apache Kafka) is a plus.
Don't hesitate to apply even if you missed some of the criteria


Salary:

Gross salary 3310 - 6950 EUR/month. Keep in mind that we are open to discuss a different salary based on your skills and competences.



Up for the challenge? Let’s talk

  • Senior Data Engineer

    2 weeks ago

    Vilnius, Vilnius, Lithuania Telia Full time

    Senior Data Engineer (For Norway). Telia offers job. Senior Data Engineer Ready to make better happen? We are expanding the Data Analytics.

  • Data Platform Engineer

    3 weeks ago

    Vilnius, Vilnius, Lithuania Telia Full time

    Data Platform Engineer (Cloud). Telia offers job. Data Platform Engineer (Cloud) Ready to make better happen? I am Augustas Degutis,.

  • Mid/Senior Data Engineer

    2 weeks ago

    Vilnius, Vilnius, Lithuania Telia Full time

    Mid/Senior Data Engineer (For Revenue Assurance). Telia offers job. Data Engineer Have you already heard of Data Analytic Hub at Telia Global Services.

  • Data Engineer in Vilnius

    3 days ago

    Vilnius, Vilnius, Lithuania Telia Full time

    Data Engineer. Telia offers job. Do you want to help Telia Lithuania by driving business results with analytics?.

  • GenAI Data Engineer in Vilnius

    2 weeks ago

    Vilnius, Vilnius, Lithuania Danske Bank AS Lietuvos filialas Full time

    GenAI Data Engineer. Danske Bank A/S Lietuvos filialas offers job. Area Would you like to join our Tech Strategy unit working with Generative AI in.

  • Senior Data Platform Engineer

    2 weeks ago

    Vilnius, Vilnius, Lithuania Oxylabs Full time

    We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone...

  • Chief Engineer in Data Platform Tribe in Vilnius

    2 weeks ago

    Vilnius, Vilnius, Lithuania Danske Bank AS Lietuvos filialas Full time

    Chief Engineer in Data Platform Tribe. Danske Bank A/S Lietuvos filialas offers job. Area Would you like to be part of Data & Analytics and play an important role.

  • Data Engineer in Financial Crime Lifecycle Management Tribe in Vilnius

    2 days ago

    Vilnius, Vilnius, Lithuania Danske Bank AS Lietuvos filialas Full time

    Data Engineer in Financial Crime Lifecycle Management Tribe. Danske Bank A/S Lietuvos filialas offers job. Area We are looking for a Data Engineer with an agile mind set interested in developing.

  • Senior Data Platform Engineer

    4 weeks ago

    Vilnius, Lithuania Oxylabs Full time

    We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone...

  • Senior Big Data Engineer in Vilnius

    3 weeks ago

    Vilnius, Vilnius, Lithuania Danske Bank AS Lietuvos filialas Full time

    Senior Big Data Engineer. Danske Bank A/S Lietuvos filialas offers job. Area We believe taking risks is crucial in banking, and we' re committed to.

  • Senior Data Engineer in Financial Crime Lifecycle Management Tribe in Vilnius

    6 hours ago

    Vilnius, Vilnius, Lithuania Danske Bank AS Lietuvos filialas Full time

    Senior Data Engineer in Financial Crime Lifecycle Management Tribe. Danske Bank A/S Lietuvos filialas offers job. Area Senior Data Engineer in Financial Crime Lifecycle Management TribWelcome to.

  • Data Engineer

    2 weeks ago

    Vilnius, Vilnius, Lithuania Oxylabs Full time

    We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone...

  • Data Engineer in Large Corporates and Institutions Analytics Team in Vilnius

    4 days ago

    Vilnius, Vilnius, Lithuania Danske Bank AS Lietuvos filialas Full time

    Data Engineer in Large Corporates and Institutions Analytics Team. Danske Bank A/S Lietuvos filialas offers job. Area Do you believe in the power of data in business? Then we see eye to eye, read.

  • Senior Data Engineer

    3 weeks ago

    Vilnius, Lithuania Oxylabs Full time

    We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone...

  • Senior Data Engineer

    2 weeks ago

    Vilnius, Vilnius, Lithuania Oxylabs Full time

    We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone...

  • Data Engineering Chapter Lead for Risk and Compliance Tribe in Vilnius

    2 weeks ago

    Vilnius, Vilnius, Lithuania Danske Bank AS Lietuvos filialas Full time

    Data Engineering Chapter Lead for Risk and Compliance Tribe. Danske Bank A/S Lietuvos filialas offers job. Area We believe taking risks is crucial in banking, and we're committed to changing.

  • Data Engineer

    3 weeks ago

    Vilnius, Lithuania Oxylabs Full time

    We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone...

  • Software Engineering Team Lead in Vilnius

    2 weeks ago

    Vilnius, Vilnius, Lithuania Alliance for Recruitment Full time

    Software Engineering Team Lead. Alliance for Recruitment offers job. ABOUT THE PROJECT: OAG is in the process of creating a new generation data platform.

  • Mid-Senior DevOps Engineer

    3 weeks ago

    Vilnius, Vilnius, Lithuania Oxylabs Full time

    We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone...

  • Mid-Senior DevOps Engineer

    3 weeks ago

    Vilnius, Lithuania Oxylabs Full time

    We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone...