ScribeMe App Overview and Settings
Siena demonstrated the app’s interface, navigation, and customization options.
- Details
- Siena: Showed five main tabs – Home, Snap and Scribe, Live Assist, Upgrade, and Profile
- Settings include haptic feedback, processing sounds, dark mode, language options, and voice selection for Live Assist
- Six voice options available: Anna, Sophia, Veena, Leo, Max, and Alex
- Ali: Suggested Voice 4 (Leo) as a preference
- Siena: Selected Sophia as the Live Assist voice after testing multiple options
- Conclusion
- App is highly customizable with accessibility features
- Voice selection is a matter of personal preference
- Settings allow for language customization across different features
PDF Scanning and Reading Functionality
Siena demonstrated uploading and scanning a 300-page Roland EX50 keyboard manual.
- Details
- Siena: Uploaded the manual from iCloud Drive, which took several minutes to process due to file size
- Earl: Confirmed that larger files take longer to scan, even smaller 8-9 page files can take about a minute
- The app extracted text, labeled headings and lists, generated detailed alt text for images, and allowed navigation by headings
- Siena: Demonstrated asking AI questions about the document, such as locating specific buttons
- The AI provided contextual answers based on the manual content but acknowledged limitations when diagrams weren’t detailed enough
- Conclusion
- PDF scanning is highly effective for technical manuals and documents with images
- Processing time varies with file size
- AI question feature is useful but has limitations based on available information in the document
- Paid subscription allows up to 400 pages per file; free version limited to 10 pages
PowerPoint File Demonstration
Siena created a PowerPoint summary of the Focus Blue braille display manual using ChatGPT, then scanned it with ScribeMe.
- Details
- Siena: Used ChatGPT to generate a PowerPoint presentation summarizing the Focus Blue user manual
- Demonstrated using the share sheet to open the PowerPoint file in ScribeMe
- Earl: Explained that files can be shared directly from Dropbox or other cloud services to ScribeMe via the share sheet
- Hans: Asked about accessing files from external sources like Dropbox or pCloud
- The app successfully read the PowerPoint content including bullet points and headings
- Conclusion
- ScribeMe can read PowerPoint files even without PowerPoint installed on the device
- Share sheet integration provides flexible file access from various cloud storage services
- Useful for accessing presentation content on mobile devices
Snap and Scribe Photo Feature
Siena demonstrated taking photos and receiving detailed descriptions.
- Details
- Siena: Took a selfie which was described in detail including headset, room features, lighting, and facial expression
- New facial recognition feature allows users to save photos of people for identification in future photos
- Siena: Added her own photo to the recognition database
- Hans: Noted that photos taken in portrait mode sometimes appear rotated 90 degrees counterclockwise
- Earl: Confirmed orientation lock works fine for him
- Liz: Asked about practical applications like identifying people at dinner tables or reading utility bills
- Conclusion
- Photo descriptions are extremely detailed, including environmental context
- Facial recognition feature requires permission and consent from individuals
- Orientation issues may vary by device settings
- Useful for scanning physical documents like bills or cooking instructions
Live Assist Real-Time Visual Assistance
Siena demonstrated the Live Assist feature with real-time AI-powered descriptions.
- Details
- Siena: Used Live Assist to describe her workspace, including laptop, keyboards, and braille display
- Demonstrated identifying buttons on the Roland EX50 keyboard with mixed accuracy
- The AI voice (Sophia) provided conversational, real-time responses
- Jackie: Impressed by how realistic the AI voice sounded, initially thought it was a human volunteer
- Liz: Asked about using Live Assist while walking in a mall to identify stores
- Hans: Clarified that free users get 10 minutes per day with a 24-hour reset period from time of use
- Jackie: Expressed interest in using it for cooking instructions and thermostat adjustments
- Conclusion
- Live Assist provides conversational, real-time visual assistance
- AI voice quality is highly realistic and natural-sounding
- Free version limitation of 10 minutes per day may be restrictive for complex tasks
- Useful for navigation, object identification, and reading labels
- Works with Meta glasses for hands-free operation
Subscription Costs and Value Discussion
Participants discussed the pricing and whether the subscription is worthwhile.
- Details
- Siena: Confirmed the paid subscription costs $24 per month
- Multiple participants: Expressed concern about having too many subscriptions
- Ali: Mentioned cutting back on subscriptions
- Earl: Acknowledged it’s a good product but questioned how many subscriptions one wants to pay for
- Liz: Called it pricey but acknowledged value depends on individual needs
- Jackie: Preferred to use the free version as much as possible to avoid extra costs
- Hans: Noted the free version recently increased from 4 to 10 minutes of Live Assist per day
- Conclusion
- Subscription cost is a significant consideration for many users
- Value depends on frequency of use and specific needs
- Free version provides enough functionality for occasional users
- Recommendation to try free version before committing to paid subscription
Security and Privacy Concerns
Discussion about data security when scanning sensitive documents.
- Details
- Liz: Raised concerns about security when scanning financial documents
- Earl: Explained that ScribeMe processes content through the internet, not on-device
- Earl: Recommended VDScan for on-device processing of sensitive documents
- Ali: Asked about VDScan’s development status by Winston Chen
- Earl: Confirmed VDScan hasn’t been updated recently but Voice Dream Reader (sold to Applause group) is actively maintained
- Conclusion
- ScribeMe is not suitable for highly sensitive financial documents due to internet processing
- VDScan offers on-device processing for security-conscious users
- Users should consider security implications when choosing which app to use for different document types
Practical Use Cases and Limitations
Participants explored various applications and constraints of ScribeMe features.
- Details
- Liz: Questioned advantages over VoiceOver’s built-in PDF reading
- Siena: Explained ScribeMe excels at describing images, tables, and charts that lack alt text
- Jackie: Interested in using for cooking instructions and thermostat adjustments
- Liz: Asked about identifying people in social situations like church gatherings
- Siena: Explained facial recognition works best in static situations like seated dinners, not mingling crowds
- Jackie: Expressed frustration with taking photos due to focus and positioning challenges
- Hans: Noted Snap and Scribe allows one photo at a time on free version, similar to Be My Eyes
- Conclusion
- ScribeMe adds value beyond standard screen readers for image-heavy documents
- Live Assist is more practical than photo-taking for real-time needs
- Facial recognition has limitations in dynamic social situations
- Free version restrictions are manageable for basic use cases
- Live Assist sessions cannot be saved for later reference
File History and Session Recording
Discussion about saving and accessing previous scans and sessions.
- Details
- Siena: Demonstrated accessing previously scanned files through Profile > File History
- Jackie: Asked if Live Assist sessions can be saved
- Hans and Siena: Confirmed Live Assist sessions cannot be saved
- Siena: Explained file history only works for scanned PDFs, PowerPoints, and images, not Live Assist sessions
- Conclusion
- Scanned documents are saved in file history for future access
- Live Assist sessions are not recorded or saved
- Users must complete tasks within their Live Assist time limit
Stay tuned for the updated topic schedule for the next couple months of workshops, coming very soon!
Contact the team:
Like us on Facebook
https://www.facebook.com/profile.php?id=61578990010675
Follow the Show:
On Tunein
On Apple Podcasts:
On Audible:
On iHeart:
On Spotify
Leave a comment