[NEW PLUGIN] FaceOS šŸ¤– Local AI Face Recognition, Biometrics & Emotion Analysis (Zero API Costs!)

Hey Bubblers! :waving_hand:

We all know the struggle: you want to add Face Recognition or Biometric Login to your app, but you get stuck with complex setups like Amazon Rekognition, Azure Face API, or Google Cloud.

And then… the bills start coming in for every single API call. :money_with_wings:

I built FaceOS to solve this. It’s a powerful AI Vision engine that runs 100% locally in your user’s browser using TensorFlow.js.

This means:

  1. Zero API Costs: Scan 1 face or 1 million faces. It costs you $0.

  2. Privacy First: Images are processed in the browser memory. They never leave the device unless you explicitly save a snapshot. GDPR compliance made easy.

  3. Real-Time: No network latency. It works instantly.

I’ve released two editions to suit different needs:

:rocket: FaceOS - Pro Edition (The Biometric Suite)

This is a full-blown security and analytics tool. It converts faces into mathematical ā€œdescriptorsā€ that you can save to your Bubble database to identify users.

:fire: Pro Exclusive Features:

  • :id_button: Face Recognition (Login): Compare the live camera feed against your database of users. If it finds a match, you get the User’s Name and Confidence Score. Perfect for passwordless login or clock-in systems.

  • :performing_arts: Emotion AI: Detects 7 emotions in real-time (Happy, Sad, Angry, Surprised, etc.). Great for customer satisfaction apps.

  • :bar_chart: Demographics: Instantly estimates Age and Gender (e.g., ā€œMale, approx 30 years oldā€). Useful for smart retail kiosks.

  • :camera_with_flash: Security Snapshots: Capture a Base64 image of the user the exact moment they are recognized for your audit logs.

  • :mobile_phone: Mobile Ready: Includes actions to instantly switch between Front (Selfie) and Back (Environment) cameras.

:backhand_index_pointing_right: Get the Pro Version here: PRO VERSION

:wrapped_gift: FaceOS - Free Edition (The Detector)

I wanted to give the community a robust tool for basic detection without any barriers.

What can the Free version do?

  • Face Detection: Draws a bounding box around every face in the frame.

  • People Counter: Returns the number of people currently looking at the camera (State: Face Count).

  • Auto-Start: Wake up the camera immediately or control it via workflows.

  • Smart Triggers: Events for Face Detected and Face Lost.

:backhand_index_pointing_right: Get the Free Version here: FREE VERSION

:light_bulb: How does the ā€œLoginā€ work?

It’s simple math, not magic.

  1. Enrollment: When a user signs up, the plugin scans their face and outputs a JSON text string (Descriptor). You save this to the User’s thing.

  2. Login: When a user returns, you load that list of Descriptors into the plugin. The plugin compares the live video to the list and tells you: ā€œIt’s User #123 with 98% confidence.ā€

No data is sent to me, Amazon, or Google. You own the data.

Let me know if you have any questions or feature requests! :robot:

Happy Bubbling!

Hello Bubblers! :waving_hand:

We are excited to announce FaceOS V2, a major update that turns your Bubble app into a professional Biometric Identity tool. We focused heavily on UX and Privacy for this release.

What’s New?

:shield: True Privacy Mode (GDPR Friendly) Need to count people or detect demographics in a public space without violating privacy?

  • Enable Privacy Mode to automatically blur or mask faces in the video feed.

  • You still get all the data (Age, Gender, Emotions, Unique ID) but the visual identity is protected!

:bullseye: Smart Face Guidance Stop users from taking bad photos!

  • The plugin now calculates the face position and distance.

  • It exposes a Guidance Text state that tells the user exactly what to do: ā€œMove Closerā€, ā€œMove Backā€, or ā€œCenter your Faceā€.

:camera_with_flash: Auto-Capture (Selfie)

  • Why make the user press a button? If Enable Auto Capture is on, the plugin waits for the ā€œPerfectā€ position and automatically snaps the photo for you.

:brain: Stability & Performance

  • Added robust ā€œMedia Readyā€ checks to prevent console errors on startup.

  • Fixed the ā€œMirrored Textā€ issue—video is mirrored, but labels remain readable!

  • Added a Match Threshold input to the database loader for fine-tuning security levels.

Happy building! :robot::sparkles:

Hey Bubblers! :waving_hand:

I’m excited to announce a massive update to FaceOS! While v2 focused on AI-powered facial recognition via camera, v3 introduces True Native Biometrics.

What does this mean? You can now trigger the actual iOS Face ID or Android Fingerprint sensor directly from your Bubble app!

Key Features:

  • :white_check_mark: Native Feel: Uses the actual OS-level security popups.

  • :white_check_mark: Universal: Works in Safari, Chrome, PWAs, and Mobile Wrappers (BDK, Nativator, etc.).

  • :white_check_mark: Modular: New FaceOS Biometrics element is lightweight and separate from the AI camera logic.

  • :white_check_mark: Secure: Built on the WebAuthn API—no biometric data ever leaves the device or touches your server.

Web vs. Native Beta: To be clear: this uses the powerful WebAuthn API. It is perfect for those building Web Apps, PWAs, or using Wrappers. It provides that ā€œNative Appā€ experience your users love without the limitations of the current Bubble Native Beta.

Note to Developer: This includes Touch ID! WebAuthn automatically detects if the device uses Face ID (iPhone FaceID/Mac) or Touch ID (Older iPhones/Android fingerprints) and shows the appropriate UI. :bullseye:

Check it out in the marketplace and let me know what you think!

Happy bubbling! :bubbles: