Skip to main content

AI Assistant (Mobile)

voice vs typing speed
speaking is 3× faster than typing on a mobile keyboard for field note entry
68%
push-to-talk adoption
field workers choose push-to-talk over text forms once they try it once
4–5
clicks to log a note
'every action is 4–5 clicks when it should be one' — complexity drives abandonment

On mobile the AI isn't a screen — it's a button you hold. Press and hold the AI button in the bottom tab bar, speak your request, release. The AI processes it and speaks the answer back while you're already moving. No typing. No navigating menus. Hands stay free on the job site.

Surface: Mobile App · Interaction: Push-to-Talk · Last Updated: 2026-05-16

Same intelligence, different surface. Every voice session has full access to your CRM — contacts, projects, invoices, team locations, schedule. Anything you can do on desktop, you can do with your voice in the field.

The Interface

The AI button lives at the center of the bottom tab bar. Tap it to see recent conversations. Hold it to speak.

Three states:

  • Idle (tap to open) — Shows recent AI conversation history: previous questions, actions taken, timestamps. Hint text prompts "Hold the AI button below to speak a command or ask anything."
  • Held (listening) — Dark overlay drops. Pulsing mic orb appears. Live transcript renders as you speak. "Release to send" hint. Slide up to cancel.
  • Response (speaking back) — Shows "You asked" card with your question and "AI Assistant" response card with the answer read aloud. Quick-action buttons appear below.

How It Works

  1. Press and hold the AI button — The dark overlay drops instantly. The pulsing orb appears. The mic opens — no loading, no tap-to-start. Just hold and speak.
  2. Speak your request — Your words appear live as a transcript below the orb. The seven-bar visualizer responds to your voice volume. Pauses create paragraph breaks — you can chain multi-part instructions in a single hold.
  3. Release to send — or slide up to cancel — Release anywhere in the center zone to send. Slide your thumb up first and the cancel pill turns red — release there to discard without sending.
  4. AI responds in text and voice — The response appears in the conversation card and is read aloud through your speaker or earpiece. Quick action buttons surface below — tap to get directions, open a record, or follow up.
  5. Session syncs to desktop automatically — Every voice exchange appears in the AI Assistant conversation history on the web interface. Nothing is lost — every question, answer, and action is logged.

Voice Commands — Field Use Cases

The AI understands natural language. These are real things contractors say on the job.

You SayWhat HappensCategory
"What's on my schedule today?"Reads today's jobs in time order with addresses, customer names, and crew assignments.Schedule
"Get me directions to the Henderson job"Looks up the job address and opens native Maps with turn-by-turn directions.Navigation
"Mark the Martinez job as complete"Updates project status, triggers invoice generation, notifies the customer automatically.Projects
"Add a note: customer wants a metal roof upgrade, follow up in spring"Logs the note to the active project and creates a follow-up task for spring.Notes
"Who's closest to 14 Oak Street right now?"Checks live GPS of all clocked-in crew and names the closest tech with ETA.Team
"Send Karen the payment link for her invoice"Finds the open invoice, generates a payment link, and sends it by SMS — confirms back.Invoices
"New contact — Rick Delgado, 555-210-4400, commercial lead, referral"Creates the contact, tags as Lead, notes the referral source, schedules a follow-up task.Contacts
"How much did we collect this week?"Pulls week-to-date collected revenue, reads the total aloud with a per-job breakdown.Reports

What the AI Knows on Mobile

Same full context as the desktop — the AI doesn't get a stripped-down data set just because you're in the field.

ContextWhat's Available
All ProjectsEvery project, status, assigned crew, address, job notes, and photo history.
All ContactsCustomers, vendors, subs, leads — with full activity history and communication records.
Live Crew LocationsReal-time GPS positions for all clocked-in team members. AI can dispatch by proximity.
Invoices & PaymentsOpen invoices, payment status, outstanding balances — send payment links on the spot.
Today's ScheduleAppointment times, job addresses, customer names, and notes from prior visits.
Conversation HistoryEvery SMS, email, and call log from every customer. AI knows what was said and when.

Settings

Configure PTT sensitivity and voice reply behavior in Settings → AI Assistant.

SettingDescriptionDefault
Hold DurationHow long before PTT activates — Short (150ms), Normal (250ms), Long (500ms)Normal
Voice ReplyAI reads responses aloud through speaker or earpieceOn
Speaking RateSpeed of voice reply playback — Slow, Normal, FastNormal
Recognition LanguageLanguage for speech-to-text; defaults to device languageAuto
Offline QueueCommands issued without signal queue and execute when connectivity resumesEnabled