Job: Researcher
Department: Data Science & Big Data Analytics
Location: Barcelona (Spain)
Sector: Internet and technology
Vacancies: 1
Discipline: R&D
Work modality: HybridEurecat is the second Research & Technology Organisation in Spain and one of the largest applied research and technology transfer organisation in Southern
Europe. It brings together the experience of more than 800 professionals who generate an annual turnover of 69 million euros and provides services to more than 2,000 companies. Eurecat integrates advanced digital capabilities and experience in biotechnology, industry and sustainability and collaborates with industry in R+D+I activities and projects, offering advanced scientific and technological services and specialized knowledge to respond effectively to the technological needs of very different business sectors, accelerating innovation, reducing both risks and spendings on scientific and technological infrastructures. The technology center participates in more than 200 large national and international consortium projects of high strategic R&I, has 230 patents and 10 spin-offs. Eurecat has eleven centers in Catalonia and presence in Madrid, Malaga and Chile.
EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit.
FUNCTIONS AND RESPONSIBILITIES OF THE JOB:
· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.
· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.
· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.
· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.
· Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).
· When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.
· Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…)
REQUIREMENTS:
Studies
· MsC in Computer Science. Other technical background will also be considered (Engineer, Mathematics, Physics, etc.) and PhD or Masters in this field will be highly valuated.
Experience
· Database Systems (MySQL, PostgreSQL, MongoDB, ElasticSearch, Cassandra DB, Redis)
· Implementation of data catalogues (CKAN), data brokers and data connectors (DSSC, Eclipse, Fiware)
· Airflow and Python based E(L)TL data pipelines.
· Cloud providers technological stack (Serverless functions, Virtual Computing Resources, Storage).
· Software patterns best practices as well as knowledge from Data Mining and Machine Learning.
· Languages and programming tools (Python, Java, Scala, SQL, C/C++, Git, Docker)
· DevOps knowledge and experience in Linux is a big plus, specially deploying and maintaining big data infrastructures using Ambari or Ansible.
· Interest in Research, Innovation & Patent Publication, Conference Presentations, Prototyping, Full Lifecycle Product Development.
Languages
· Excellent written and oral communication skills in English.
· Catalan and/or Spanish would be desirable.
WHAT CAN EURECAT OFFER YOU?
?
