meta glasses gemini

Meta Rayban Glasses + Gemini Integration Project

This project integrates the Meta Rayban Glasses with a WhatsApp bot, leveraging the power of Google Gemini, Redis for data management, Notion for note-taking, and Google Calendar for event and reminder management. This README guides you through setting up the project environment, including necessary configurations and API integrations.

Getting Started

Prerequisites

• Python 3.x
• pip for Python package installation

Installation

1. Clone this repository to your local machine.

2. Navigate to the project directory.

3. Install the required Python packages:

   pip install -r requirements.txt

4. Run the project:

   uvicorn main:app --reload

Environment Variables

You need to set the following environment variables in a .env file within the project directory:

WHATSAPP_AUTH_TOKEN=
WHATSAPP_PHONE_NUMBER=
WHATSAPP_WEBHOOK_VERIFICATION_TOKEN=
REDIS_DB_HOST=
REDIS_DB_PORT=
REDIS_DB_PASSWORD=
GEMINI_API_KEY=
CLOUD_STORAGE_BUCKET_NAME=
NOTION_INTEGRATION_SECRET=
NOTION_DATABASE_ID=
SERPER_DEV_API_KEY=
CRAWLBASE_API_KEY=
OAUTH_CREDENTIALS_ENCODED=

• WHATSAPP_AUTH_TOKEN: Create an app at Meta for Developers and retrieve the WhatsApp authentication token.
• WHATSAPP_PHONE_NUMBER: The phone number associated with your WhatsApp API.
• WHATSAPP_WEBHOOK_VERIFICATION_TOKEN: Set a verification token of your choice and use it in the Meta for Developers dashboard to verify the webhook.
• REDIS_DB_HOST, REDIS_DB_PORT, REDIS_DB_PASSWORD: Credentials for your Redis database. This project uses Redis for managing data, including storing images for analysis.
• GEMINI_API_KEY: Obtain this from the Google Gemini API for image analysis and AI capabilities.
• CLOUD_STORAGE_BUCKET_NAME: The name of your Google Cloud Storage bucket for storing images and data.
• NOTION_INTEGRATION_SECRET, NOTION_DATABASE_ID: Create a Notion integration and a database with fields (Title, Category, Content, Created At, Completed). Share the database with the integration.
• SERPER_DEV_API_KEY, CRAWLBASE_API_KEY: Obtain these API keys from the respective websites to enable advanced search and data retrieval functionalities.
• OAUTH_CREDENTIALS_ENCODED: Base64 encode your Google OAuth credentials and set them here.

Additional Configuration

• Google Cloud Platform Credentials: Place your google-credentials.json file in the project root. This file should contain credentials for your GCP project.
• Google OAuth Token: Ensure you have a credentials.json file for OAuth to enable Google Calendar integrations. Follow the Google Calendar API documentation to obtain this token.
• Create a Meta App: Create an app at Meta for Developers to obtain the WhatsApp API credentials, and setup the webhook to your URL.