Arlene Martin

Arlene Martin

Extract and Verify Book Titles from Bookshelf Photos using GPT-4o and Google Books

**Use Case: **
Analyze images with multiple subjects. In this use case I have a bookshelf and am extracting and verifying book titles/authors from a bookshelf photo.

**How it works: **

  1. Webhook receives an image url from a front end in which a user can upload a picture.
    • In this use case, it is an image of a book shelf.
  2. Edit Field (Set): Saves image in a consistent location so AI can find it.
  3. Analyze Image: Image is analyzed.
    • Extracts titles from the book spines
  4. Code: Splits extracted subjects to single item to be able to validate each item separately.
    • Books are individualized to their own entity
  5. **HTTP Request **validates each subject.
    • Queries Google Books to validate books in case only partial titles were found.
  6. Edit Field (Set): Tidies the result.
  7. Code: Aggregates and deduplicates
    • Titles and authors are aggregate into a list
  8. Respond to Webhook returns list to front end

How to use:
Use with a frontend that can capture images and receive back the result. For this use case Supabase was used to store images from which the image analyzer could reference.

Do you want to automate your business?

Let's talk about your project