109

Storyblocks

✨ Experience the enchantment of Story Block an open-source project merging AI text generation and image synthesis to create captivating video narratives. 📚🎥 Watch as your text prompts come to life with stunning visuals, exploring new frontiers in storytelling!

Story Block

Story Block is an open-source project that utilizes generative AI to transform text into visual narratives. By combining OpenAI's text generation model and Stable Diffusion(Automatic1111) with LORA for image synthesis, this project allows users to explore new frontiers of storytelling.

One Click Run Google Colab

Features

  • Transforms text prompts into captivating video narratives with vivid visuals
  • Uses cutting-edge AI technology for text, image, video generation like OpenAI , Automatic1111 and ElevenLabs
  • Customizable options to tailor user experience

Usage

To use Story Block, simply provide a text prompt and watch as the project generates a unique story accompanied by stunning visuals. Users can customize their experience by adjusting various parameters such as image style and animation speed.

Todo list

  • complete video compilation pipeline
  • add stable diffusion support for image generation
  • add automatic1111 APIs
  • add diffusechain
  • Convert it into a Python file
  • Add Colab notebook
  • Add Gradio
  • Add proper Subtitles support
  • Add Support for other image generation models (from Stability AI)
  • Add support for flashcards
  • prompts optimization

🌟 Show Your Support

We hope you find Storyblocks helpful! If you do, let us know by giving us a star ⭐ on the repo. It's easy, just click on the 'Star' button at the top right of the page. Your support means a lot to us and keeps us motivated to improve and expand Storyblocks. Thank you and happy content creating! 🎉

GitHub star chart

Instructions for running Storyblocks

This guide provides step-by-step instructions for installing ImageMagick and FFmpeg on your system, which are both required to do automated editing. Once installed, you can proceed to run runStoryblocks.py successfully.

Prerequisites

Before you begin, ensure that you have the following prerequisites installed on your system:

  • Python 3.x
  • Pip (Python package installer)

Installation Steps

Follow the instructions below to install ImageMagick, FFmpeg, and clone the Storyblocks repository:

Step 1: Install ImageMagick

  1. For Windows download the installer from the official ImageMagick website and follow the installation instructions. https://imagemagick.org/script/download.php

  2. For Ubuntu/Debian-based systems, use the command:

    sudo apt-get install imagemagick
    

    Then run the following command to fix a moviepy Imagemagick policy.xml incompatibility problem:

    !sed -i '/<policy domain="path" rights="none" pattern="@\*"/d' /etc/ImageMagick-6/policy.xml
    
  3. For macOS using Homebrew, use the command:

    brew install imagemagick
    
  4. Verify the installation by running the following command:

    convert --version
    

    You should see the ImageMagick version information if the installation was successful.

Step 2: Install FFmpeg (REQUIRED FOR STORYBLOCKS TO WORK)

  1. For WindowsDownload the FFmpeg binaries from this Windows Installer (It will download ffmpeg, ffprobe and add it to your path). https://github.com/icedterminal/ffmpeg-installer/releases/tag/6.0.0.20230306

  2. For macOS using Homebrew, use the command:

    brew install ffmpeg
    

    For Ubuntu/Debian-based systems, use the command:

    sudo apt-get install ffmpeg
    
  3. Verify the installation by running the following command:

    ffmpeg -version
    

    You should see the FFmpeg version information if the installation was successful.

Step 3: Clone the Storyblocks Repository

  1. Open a terminal or command prompt.
  2. Execute the following command to clone the Storyblocks repository:
    git clone https://github.com/adithya-s-k/Storyblocks.git
    

Step 4: Install Python Dependencies

  1. Open a terminal or command prompt.

  2. Navigate to the directory where runStoryblocks.py is located (the cloned repo).

  3. Execute the following command to install the required Python dependencies:

    pip install -r requirements.txt
    

    This command will install the necessary packages specified in the requirements.txt file.

Running runStoryblocks.py Web Interface

Once you have successfully installed ImageMagick, FFmpeg, and the Python dependencies, you can run runStoryblocks.py by following these steps:

  1. Open a terminal or command prompt.
  2. Navigate to the directory where runStoryblocks.py is located (the cloned repo).
  3. Execute the following command to run the script:
    python runStoryblocks.py
    
  4. After running the script, a Gradio interface should open at your local host on port 4000 (http://localhost:4000).

Contributing

We welcome contributions from the community to help improve Story Block. To contribute, please follow these steps:

  1. Fork the repository.
  2. Create a new branch and make your changes.
  3. Submit a pull request.

Technologies Used

Storyblocks utilizes the following technologies to power its functionality:

  • Moviepy: Moviepy is used for video editing, allowing Storyblocks to make video editing and rendering

  • Openai: Openai is used for automating the entire process, including generating scripts and prompts for LLM automated editing processes.

  • ElevenLabs: ElevenLabs is used for voice synthesis, supporting multiple languages for voiceover creation.

  • Diffusechain: A library that makes it easier to generate images using diffusion models.

  • Automatic1111: A UI first project which is used to generate , modify images and much more.

These technologies work together to provide a seamless and efficient experience in automating video and short content creation with AI.

License

Story Block is licensed under the MIT License. See LICENSE for more information.

Contact

Stay updated with the latest happenings, announcements, and insights about Story Block by checking out my Twitter accounts. Engage in fascinating dialogues, access the latest news about the project, and gain insights from the person behind Story Block.