Research Consultant (Multimodal)

About the project

We are working with a Spain-based Figma competitor focusing on a community-first and open-source design-first approach. As a design company, it is evolving into an AI-first company with a need to build a foundational model that encompasses several modalities:

• visual (raster images PNG, JPEG, etc)

• code (vector graphics in SVG, design tokens)

• textual (documentation, comments)

• dynamic (all of the above is evolving over time)

The primary objective of this project is to establish the foundational infrastructure necessary for training advanced AI models tailored for design applications. The project aims to seamlessly integrate AI at various levels, from enhancing design workflows to realizing AI-first capabilities. Ultimately, the project sets the stage for training foundation models that cater specifically to the design domain, unlocking new possibilities and enhancing user experiences within the product.

Duration: 12 weeks

Areas of Responsibility

• AI solution architecture design and roadmap planning

• Scientific approaches recommendations

• Education of the Neurons Lab and their customer teams

• AI solution technical quality and performance management
  

Skills

• AI and ML Solutions Architecture: Expertise in AI and ML solutions architecture design, especially in areas like recommender systems, computer vision, NLP, and time series analysis.

• Advanced Engineering and Data Management: Proficiency in AI and ML solutions engineering, including data handling (data lakes, version control), software engineering (testing, Git, documentation), and model development (TensorFlow, PyTorch).

Knowledge

• Multi-modal architectures

  • Familiar with the NLP, CV based architectures

• Emerging Technologies:

  • Awareness of emerging technologies and frameworks in machine learning.

  • Familiar with Few-shot learning, RAG, or fine-tuning of commercial or open-source models (Mistral/Llama)

Experience

• Building NLP-based systems hands-on, 5+ years

• Building computer vision algorithms hands-on, 5+ years

• Optimizing and deploying AL/ML/DL algorithms, 3+ years

• Development with major cloud providers (AWS, Azure, GCP), 3+ years

• Leading machine learning teams, 2+ years

Terms & conditions

Allocation: 5 hours per month

Time zone: the customer is in the European timezone

We offer

• Scientific or engineering challenges

• Work with disruptive deep-tech startups

• Work with rock stars (senior-level engineers, Ph.D.)

• Meaningful social and environmental projects

• Transparent, professional growth plan depending on your impact

• Remote work from any location

• Flexible working hours

• Regular Team Building & company-wide team events