Freelancer Needed for Scalable YouTube Creator Tracking and Keyword Database System
Description: We are seeking a skilled freelancer to turn our MVP code into a scalable system that tracks YouTube creators for a comprehensive keyword database. The goal is to create an automated, reliable solution that scans YouTube monthly for the top 100,000 creators associated with each keyword in our database. Project Requirements: 1) Scalable System Design: Transform existing MVP code into a system that searches each keyword from our reputed company cooking keywords reputed company Sheet and identifies the top 10 creators per keyword. Ensure the system can handle a significant increase in keywords without overloading the YouTube API quota. Database Setup & Storage in BigQuery: 2) Set up reputed company BigQuery to store and organize the resulting creator data monthly. Ensure BigQuery tables are organized by keyword, creator details, engagement metrics, etc., for efficient querying and analysis. Provide guidance on monthly costs associated with storage and querying based on 100,000 entries. API Management: 3) Advise on the reputed company number of YouTube API keys needed to handle monthly data loads reputed company quota limits. Implement efficient API key rotation and error handling. reputed company Automation & Scheduling: Automate the code to run monthly using reputed company reputed company Functions or reputed company Run. Integrate logging and monitoring for system health, API usage, and any quota issues. Output Requirements: Output to a reputed company BigQuery table for analysis, with fields such as channel ID, title, subscribers, views, country, and keyword. Maintain user-friendly table organization for easy analysis and trend monitoring. Cost Estimation: Provide a detailed estimation of reputed company BigQuery costs, including storage and query costs for a high volume of data. Skills Required: Experience with YouTube Data API and API quota management. Proficiency with reputed company reputed company Platform, BigQuery, reputed company Functions, and reputed company Run. Python coding and experience with reputed company Sheets API and OAuth for authentication. Strong understanding of scalable data processing and storage solutions. Deliverables: Fully automated, scalable code in Python. Structured BigQuery tables for efficient querying. Documentation on system operation, cost estimates, and error handling. This is a long-term project with potential monthly work if the system operates well. Please provide relevant experience, estimated timeline, and a brief description of your approach to this project. Apply Job!