Docker on Techetio

How To: Running Your Own Large Language Model On Linux

Mon, 15 Jan 2024 19:30:55 +0000

With the recent advent of large language models, the open source community has done what they tend to do quite often, and they created their own. There are all sorts of tools out there for running your own large language models, and all sorts of pretrained models that you can use out of the box or even build on top of. I’ll be going over the easiest way (updated and still accurate for 2025) to run your own large language model on your own computer.

A Seamless Authenticated Proxy Solution For Selenium

Sun, 24 Dec 2023 20:41:08 +0000

Forwarding Requests To An Authenticated Proxy With Squid

In my web scraping adventures, I’ve run into the problem of attempting to use an authenticated proxy with Selenium. Using a proxy is relatively easy to configure in most web browsers, but handling authentication with proxies in selenium is far less trivial. For instance in Chrome, the solution is to create an extension with a listener on the onAuthRequired event in order to know when to submit the credentials for the proxy. These hacks vary across web browsers as well.

Creating A Default DEV Container File For GitHub Codespaces

Sat, 02 Dec 2023 11:46:12 +0000

GitHub Codespaces is an incredible offering that lets you run Visual Studio Code within a Docker container in the cloud, from your browser. What makes this offering a real game changer is when you couple that with all the dependencies needed to get a development environment configured correctly. Imagine how much time this would save developers working on larger complicated projects. I know I’ve definitely worked on projects where I spent hours finding all the random dependencies and compiler settings needed just to get the project to build. For some of my projects, I made an effort to set up some files for Codespace to use that would get other developers set up in less than a minute.

Reducing Docker ext4.vhdx File Size On Windows

Sat, 25 Nov 2023 05:50:52 +0000

A common issue I’ve ran into when running Docker Desktop on Windows is a virtual drive consuming a large amount of disk space. If the common methods of reducing the disk space used by Docker yield no results, you can take some extra measures.

Hopefully it goes without saying, you should regularly run the below command to get rid of any dangling and unused images eating up disk space:

docker system prune -a

If you still notice a vhdx file using a considerable amount of disk space, you can run the following commands in a command prompt to shrink the vhdx file:

How To Limit Core Dump Size In Docker

Sat, 28 Oct 2023 21:57:59 +0000

You may be filling up the disk with core dumps causing outages in your application. Or you’re troubleshooting Docker failures and don’t need 3000 core dumps. Whatever it is, you’ve decided to limit the size the core dumps can consume within Docker. Fortunately, this is a really easy fix.

The docker run command has a flag for --ulimit which can be used to set all sorts of resource limits within the container. If you’re familiar with Linux, you’ll likely have encountered ulimit in some sort of context before, and it’s behavior is exactly the same in Docker. In order to limit the core size, we need to run our containers with something like this:

How to Secure Your Docker Environment with NordVPN

Thu, 22 Dec 2022 04:41:12 +0000

Docker is a powerful tool that allows you to easily deploy and manage applications in a containerized environment. If you’re also a user of NordVPN, you may wish to pass the traffic coming from your Docker containers through Nord to secure your internet connection and protect your online privacy. By the end of this tutorial, you will know how to set up NordVPN on a Docker container and use it to protect the internet connection off other Docker containers as well. Let’s get started!