🤖AI Tech

Text, image generation and big GPUs

I find AI is genuinely one of the most interesting fields in computing and technology in general right now. It feels like back in the early days of smartphones when every years there was a big jump with new capabilities added. So this page will hopefully keep being revised often. (May 2023)

General

Image Generation & Manipulation

  • Clipdrop.co: Various Generation, Manipulation & Editing Tools by Stability AI (creators of Stable Diffusion). Includes uncrop, face swap, upscale, replace background, and more.

  • Dall-E: Cloud Service with API by OpenAI

  • Stable-Diffusion: Open & free AI models for image generations made by Stability AI, can be used in the cloud e.g. via DreamStudio oder locally on a machine with a big GPU

  • Midjourney: AI Image generator using Discord as frontend. It's paid and a bit annoying to access via discord but it does output some really solid, high quality images. Imho better then Dall-E but not as versatile as Stable Diffusion. Although I haven't used Midjourney as much so I may be biased.

  • Upscale.media: Upscale and other image improvement algorithms. Can be used to upscale AI generation low resolution images.

  • Leiapix.com: Turn 2D images to 3D animations via AI generated depth maps.

Video Generation

Generation

  • Pika.art: Generate video clips based on prompts and/or source material. Source material may consist of existing video clips or images.

Image to Video Transformations

  • D-ID: Animated faces of people with voice lines or slight head movements. Can be used to create short clips where a person is speaking some text. Mouth movements are synchronised to the spoken audio clip.

Text Generation

Conversational Interaction LLMS

  • Chat GPT: The leader in conversational AIs. A free version is available but the more advanced model and additional features are a paid service. A lot of other AI products are based on this, respectively the same API that powers ChatGPT so it can be made to do a lot of things if you know how to prompt it right.

  • Google Bard: Free conversational LLM from Google. So far (as of May 2023) not available in Europe due to Google fearing EU laws. This can be circumvented by using a VPN to a US server but so far I don't find it better then ChatGPT therefor it's not worth the hassle of using a VPN.

  • Bing AI: Free conversational LLM based on GPT4. Works well and is based on the same advanced model that ChatGPT premium uses. However you can only access it in Edge currently (May 2023).

  • HeyPi: Free conversational LLM by Inflection AI. Supposedly the model is trained in house by them and it is not using any of the other vendors LLM models. It feels very like chatGPT but if it is indeed based on their own original design this is very impressive.

  • Mixtral: Mistral based LLM. Free to use without sign-up. Responses are less moderated than with ChatGPT. Mistral can also be run locally.

Programming Assistant / AI Pair Programming

  • GitHub Copilot: Can be used as plugin in common IDEs, such as IntelliJ, Visual Studio Code etc. The broadly available version (June 2023) provides mainly helpful suggestions and advanced autocomplete funcationality while coding. Copilot X (currently in BETA) will also be able to do refactoring and have a chat prompt to answer questions.

    • Current features & how to use them:

      • Start typing code & autocomplete. Can be only a single line or a whole method block or even class.

      • Ask questions via comments. Type //q: Your question? and you will get a autocomplete with //a: answer on the next line.

      • Create unit tests via comments. Type // Create unit tests for x-y

      • Get multiple solutions for a problem. Hover over suggestions and click on the "3 dots -> Copilot" to open a window with up to 10 solutions.

  • OpenDevin: Autonomous agent that can use a variety of models as backend. Give it a task and it attempts to break it down into smaller pieces. It can then try to implement this smaller pieces on it's own directly writing code and using a shell to install dependencies.

Experimental / local clients

  • KoboldAI-Client: WebUI for text generation model, has a simple installer for windows and can self-download models such as GPT-J and others. Can be used for text-based adventures similar to aiDungeon, novel text generation or universal text generation as well as chat-based answers. Models are quite big, so a good GPU is needed.

  • FreedomGPT: Somewhat rightwing inspired LLM that can be run locally. I've tested it and it's impressive in the sense that it does indeed work locally and can talk/answer similar to ChatGPT. Afaik it's based on facebooks LAMA. Supposedly it has no filter (as compared to strongly filtered online LLMs) and therefor can give answers to even controversial topics.

Roleplaying & Gaming

  • AI Dungeon: Text based adventure generator. Similar to old school D&D or early computer games.. with the slight difference that you're playing with an all-knowing AI that can respond to everything you throw at it. Contrary to serious LLMs like ChatGPT this does allow for nsfw/violence/nonethical things that would otherwise be filtered.

  • Novel AI: Cooperative human & AI story writing generator

User Moderation & Censorship

  • Heavenbanning: The practise of banishing a user form a platform by replacing everyone they speak to with LLM responses. The banned users content/comments are only shown to themselves. Responses to the questionable content are generated by an LLM instructed to praise the user and agree with their remarks. This is similar to the concept of shadowbanning with the added benefit of keeping the segregated user engaged. The engagement of the segregated user can be advantageous in order to keep them busy and prevent them from making a new profile. And depending on the monetisation strategy of the platform the user may continue to consume ads and/or paid services.

Voice Generation & Cloning

  • ElevenLabs: Allows to easily create new voices or clone existing ones by submitting a few minutes of audio of a person speaking. Allows to easily clone voices of movie characters such as Severus Snape. I have tested this and even with poor quality audio and relatively low effort it works really well. Need some voice lines for a YouTube video, TikTok etc. but don't want to speak yourself? This is the tool to use.

  • Open AI TTS: High end text to speech api. Can be used to convert text books to audiobooks.

Music Generation

  • Suno.ai: LLM based music generation. Can be prompted similar to image generators with lyrics and a music style. Generates high quality output in multiple languages. [Impressive example]

News & Search

  • Preplexity.AI: Perplexity AI is a AI search engine offering usage of a variety of commercial models (Open AI, Opus, etc.) to search for things and the summarise the results. They also have a free but very good news aggregation sections (https://www.perplexity.ai/discover).

My custom GPTs

  • Travel Packing List Generator: I used to have notion pack list generator - but I've since converted it to a custom GPT. The GPT expects location & trip duration as input and will then google the weather and provide a customised pack list based on a list of items that I usually take with on trips.

Previouse/accNextChatGPT

Last updated