Joel, Pinto da Mata - CV
joelpintomata.com | linkedin | joelmatacv@runbox.com
Work Experience
Data Catalogue as part of DSH’s DataMesh initiative:
- Implementation of several data ingestion pipelines with Datahub, python and orchestrated with Airflow.
- Custom ingestion instrumentation for blacklisting, logging, traceability and recoverability.
- Custom multi-thread support for high-performance ingestion.
Confluent-compliant, DSH’s Schema Registry:
- Custom solution built over/around Apicurio.
- Multi-tenancy custom layer with Spring Bot.
Tech. Stack: Kafka, Kafka Streams, Airflow, Python, Java, DataHub
Implementation of a Serverless + Event-source solution for clients early service disruption notification.
- Stakeholder management
- “you build it, you ship it”
Tech. Stack: AWS (Lambda, API Gateway, CodeBuild, SQS, SNS), NodeJS, Python, Terraform
Elsevier
Implemented a large analytics platform for research data insights:
- Building data processing pipelines with Scala and Spark
- Building data analysis pipelines with Java and Kafka Streams
- Adhoc data analysis with Jupyter notebooks
Tech. Stack: Java, Scala, Python, Spark, Kafka, AWS (EMR, S3, Notebooks)
Implemented a business-specific use-case using micro-services, server-less architectures, and “Saga/Orchestrator” design patterns:
- Acting as Delegate Architect responsible cascading Elsevier’s Architectural principles, standards, and best practices. Responsible for drafting and maintaining product technical artefacts (TPRs, ADRs, etc).
- Leading cross-team technical initiatives
- Stakeholder management
Tech. Stack: Java, Spring Boot (+ Cloud Functions), MariaDB, PostgreSQL, AWS, AWS SQS, AWS ActiveMQ, Jenkins, Kubernetes
Implemented the underlying Mendeley’s Research Data search engine:
- Developing several data pipelines for metadata extraction, data classification, data enrichment, visualization generation, indexing, etc.
- Acting as Delegate Architect responsible cascading Elsevier’s Architectural principles, standards, and best practices. Responsible for drafting and maintaining product technical artefacts (TPRs, ADRs, etc).
- Leading cross-team technical initiatives
Tech. Stack: Java, Python, Spring Boot (+ Cloud Functions), Solr, Spark, Apache NiFi, AWS, AWS EMR, Gitlab, Kubernetes, Docker
PublicSonar - Senior BigData Engineer, Mar 2018 - Sep 2018
PublicSonar is a social media real-time analysis platform for early warning and incident management.
- Building data processing pipelines with Scala and Spark
- Building data analysis pipelines with Java and Kafka Streams
- Data ingestion pipelines with Apache Nifi
- Migration from stateful to stateless architectures
Tech. Stack: Golang, Kafka, RabbitMq, Mongo, Gitlab, Docker
iFlavours - Senior Backend developer, Oct 2015 - Feb 2018
Implementing a “Greenfield” e-commerce web-shop and price comparator.
Tech. Stack: Java, Scala, Spark, Spring Boot, Play Framework, Spark, Mongo, MariaDB, AWS, Gitlab, Terraform, Docker
European Space Agency (ESTEC) - IT Engineer, Feb 2011 - Sep 2015
At the European Space Agency, Developed and maintained several of their tools for the support of ESA operations related to human resources, workload management, and time tracking systems.
I’ve been furthermore engaged in several projects requirement, impact and design analysis phases.
Tech. Stack: Java, Hibernate, Oracle, Apex
Several other development roles from 2007 to 2011
Education
- Masters in Computer Engineering - Universidade Nova de Lisboa (FCT), Portugal
Certifications
- The Open Group Certified: TOGAF®
- Certified Oracle Certified Master Java SE 6 Developer
- Oracle Certified Professional Java SE 5 Programmer
- Spring Core V3
- ITIL V3 Foundations
- Green Belt Foundational Security Training
Projects
- Project Thrive - Participating in the mentorship programme by the OfferZen Foundation helping Junior Developers levelling up in their tech careers.
- https://anunciosemprego.com - A Portuguese job market place.
Tech. Stack: Hugo, Go, Python, Server-less functions.