Looking for AI app developers

[Tzanko]

Hi all,
My team and I is making an open-source library for running AI models on the phone. We are planning to create a very simple SDK which will allow you to download a model and use it on your phone. We plan to release an initial version in a month. Our library is based on llama.cpp and whisper.cpp.

We are looking for app developers who want to build mobile apps with this functionality in order to understand their needs better. Have in mind that models will be running slower on the phone than they can run on a laptop. We want to understand what uses this library could have.
If anyone is planning to build a mobile AI app, please let me know.

[Dani]

That sounds really interesting. Did you ever launch the SDK?

I am a bit in the same boat as you as DaniWeb Connect has an API but I have been really struggling getting it adopted. Sorry I can't be more help to you directly.

[Emily Johnson]

That sounds like an exciting project! An open-source library for running AI models on mobile devices could be incredibly useful for developers looking to integrate AI-driven features. While performance limitations exist, optimizing for real-time or lightweight tasks could open up many possibilities. I’d love to learn more about your SDK and its potential use cases. Have you considered applications like voice assistants, real-time transcription, or offline AI processing? Looking forward to seeing the initial release

[Pelorus_1]

Look for top-tier freelancers on platforms such as Upwork or Toptal. Think about AI development companies that specialize in machine learning, natural language processing, and deep learning.

[KamalDeepPareek]

Hey Tzanko,

That sounds like a great initiative—bringing LLMs and Whisper to mobile devices through an open-source SDK is definitely a step in the right direction, especially with how much edge AI is gaining traction.

I work with a team of mobile app developers and we're currently exploring ideas around on-device AI, especially for privacy-focused applications like:

Voice transcription and command recognition (perfect use-case for Whisper)

Offline chatbots or virtual assistants

Personalized note-taking or journaling apps with AI-generated summaries

Real-time translation or captioning tools

We’d love to learn more about your SDK—especially things like:

How customizable will model loading and inference be?

What platforms will it support first (Android/iOS)?

Any early benchmarks on performance or battery usage?

We might be interested in collaborating or testing your SDK with a few prototype apps. Let me know if you're open to sharing early builds or joining a discussion!