Mobile App

Abserny for Android and iOS

Introduction

The Abserny Mobile App brings the power of offline object detection to smartphones, making the system even more portable and accessible. The mobile version maintains all core functionality while optimizing for mobile hardware and adding platform-specific features.

Status: In Development

Why Mobile?

  • Portability: Carry Abserny wherever you go
  • Accessibility: Built-in accessibility features of iOS and Android
  • Camera Quality: Leverage high-quality smartphone cameras
  • Always Available: Quick access without carrying additional devices

Platforms

Android

Development Status: Primary development platform

  • Minimum SDK: Android 8.0 (API 26)
  • Target SDK: Android 14 (API 34)
  • Development Framework: React Native

iOS

Development Status: Planned for Phase 2

  • Minimum Version: iOS 13.0
  • Target Version: iOS 17
  • Development Framework: React Native

Current Status

The mobile app is in active development:

Completed

  • Technology stack selection (React Native)
  • Project initialization and setup
  • UI/UX design mockups
  • Development environment configuration

In Progress

  • Core UI implementation
  • Camera integration
  • Voice recognition setup
  • Object detection model optimization for mobile

Planned

  • TTS integration
  • Offline functionality implementation
  • Accessibility features
  • Beta testing
  • App store submission

Core Features

The mobile app includes all core Abserny features:

Voice Activation

  • Arabic trigger word recognition
  • Always-on listening mode (optional)
  • Tap-to-activate alternative

Object Detection

  • Real-time detection using optimized YOLOv8
  • Support for front and rear cameras
  • Flashlight integration for low-light conditions

Arabic TTS

  • Natural language descriptions
  • Adjustable speech rate
  • Volume control

Mobile-Specific Features

Additional features designed for mobile platforms:

Haptic Feedback

  • Vibration on detection start
  • Different patterns for different events
  • Customizable feedback intensity

Screen Reader Integration

  • Full TalkBack support (Android)
  • VoiceOver support (iOS)
  • Accessible UI elements

Battery Optimization

  • Efficient power management
  • Background processing limits
  • Battery saver mode

Widget Support

  • Quick activation widget
  • Recent detections widget
  • Status indicators

Architecture

The mobile app is built using React Native with native modules for performance-critical components:

Technology Stack

// React Native for cross-platform UI
import React from 'react';
import { View, Text, TouchableOpacity } from 'react-native';

// Native modules for camera and ML
import { Camera } from 'react-native-camera-kit';
import { YOLODetector } from './native-modules/detector';

// Voice recognition
import Voice from '@react-native-voice/voice';

// Text-to-speech
import Tts from 'react-native-tts';

Application Structure

  • UI Layer: React Native components
  • Business Logic: JavaScript/TypeScript
  • ML Processing: Native modules (Java/Swift)
  • Voice Processing: Native ASR/TTS libraries

Model Optimization

YOLOv8 model is optimized for mobile deployment:

  • Model quantization for smaller size
  • TensorFlow Lite conversion
  • GPU acceleration support
  • Dynamic resolution scaling

Development Roadmap

Phase 1: Foundation (Current)

Timeline: Q1 2024

  • Basic UI implementation
  • Camera integration
  • Voice recognition setup
  • Local model integration

Phase 2: Core Features

Timeline: Q2 2024

  • Object detection functionality
  • TTS integration
  • Settings and configuration
  • Offline mode implementation

Phase 3: Polish

Timeline: Q3 2024

  • UI/UX refinement
  • Performance optimization
  • Accessibility enhancements
  • Beta testing

Phase 4: Release

Timeline: Q4 2024

  • Final testing and bug fixes
  • App store submission (Android)
  • Public release
  • iOS version kickoff

Design Mockups

The mobile app features a clean, accessible interface:

  • Large, touch-friendly buttons
  • High contrast color scheme
  • Minimal UI for simplicity
  • Clear visual feedback

Key Screens

  • Home Screen: Main camera view with activation button
  • Settings: Configuration options
  • History: Recent detections log
  • Help: Tutorial and documentation

Installation (When Released)

The app will be available through official stores:

  • Android: Google Play Store
  • iOS: Apple App Store (planned)

System Requirements

Android:

  • Android 8.0 or higher
  • 2GB RAM minimum
  • Camera permission
  • Microphone permission
  • 200MB free storage

iOS (planned):

  • iOS 13.0 or higher
  • 2GB RAM minimum
  • Camera access
  • Microphone access
  • 200MB free storage

Note: Documentation will be expanded as development progresses.