Breaking free from Servers: Serverless RDBMS without the headaches

Introduction

Sometimes, you might set up an RDS instance that gets queried only a few times a day. For example, QA instances used by testing teams during office hours often stay idle for the rest of the day, yet you still have to pay for the entire instance. This can feel wasteful. We faced a similar problem and started looking for better options. That’s when we found Neon.tech.

Neon.tech is a serverless Postgres database that only charges you for what you use. One of its standout features is the ability to scale down to zero when it’s not being used, so you’re not paying for idle time. This is especially useful for situations like QA environments, where resources are only needed occasionally.

Neon.tech isn’t just about saving money, it also includes features that simplify the work of software engineers. It automatically scales up to handle increased demand, Additionally, it makes database cloning fast and straightforward, allowing developers to set up separate environments for testing or experimentation in no time. With that in mind, let’s dive deeper into the blog.

What is Neon.tech?

Neon.tech is a serverless PostgreSQL platform designed to address common database management challenges like manual scaling, idle costs, and complex configurations. It automates many processes, which can significantly simplify operations. However, adapting to its serverless approach may require some adjustment, especially for those transitioning from more traditional setups.

The fact that Neon.tech is built on PostgreSQL is a major advantage. For anyone already comfortable with PostgreSQL, there’s no need to learn a new query language or completely overhaul existing workflows. Instead, Neon enhances PostgreSQL with tools like instant branching and point-in-time recovery. These features streamline tasks like testing and disaster recovery, though not every feature will be essential for all users.

By building on PostgreSQL and adding modern capabilities, Neon offers a practical option for scalable and cost-effective database management. It’s a strong fit for teams looking to optimize their workflows and reduce operational overhead, but as with any tool, its effectiveness depends on how well it integrates with your specific needs and workflows.

How to Get Started and How Easy Is It to Switch?

1. Sign Up: Visit Neon.tech and create an account. The process is quick and intuitive, getting you started in minutes.
2. Set Up Your Database: Start your PostgreSQL database in just a few clicks using either Neon’s user friendly interface or the CLI. Both options ensure a smooth and efficient setup experience tailored to your preferences.

3. Migrate Your Data: Use Neon’s tools to transition seamlessly from your current RDS instance. The migration process is designed to minimize downtime, so your workflows remain uninterrupted.
4. Connect Your App: Update your database connection string and start using Neon immediately. With its PostgreSQL compatibility, integration is as simple as switching connection details.
   1. For instance, Consider you’re building a Django application. Here’s how you can make the switch:
   2. Add the following at the top of your settings.py:

from os import getenv
from dotenv import load_dotenv
load_dotenv()

Replace the DATABASES section in your settings.py with this configuration:

from urllib.parse import urlparse

tmpPostgres = urlparse(getenv("DATABASE_URL"))

DATABASES = {
    'default': {
        'ENGINE': 'django.db.backends.postgresql',
        'NAME': tmpPostgres.path.replace('/', ''),
        'USER': tmpPostgres.username,
        'PASSWORD': tmpPostgres.password,
        'HOST': tmpPostgres.hostname,
        'PORT': 5432,
    }
}

With this setup, all you need is to set the DATABASE_URL environment variable with the Neon.tech database URL, and your Django application will be ready to use it. Since Neon.tech is compatible with PostgreSQL drivers like psycopg2, you don’t need to modify your existing queries or codebase. Everything else remains the same, making the integration seamless.

With a comprehensive documentation and responsive support to guide you through every step. You’ll be up and running in no time, ready to experience the full benefits of Neon.

Key Features and Benefits of Neon.tech

Neon.tech brings together a host of features and benefits designed to make database management more efficient and scalable. Here are the key features of the platform:

1. Serverless Scaling: Neon automatically adjusts resources based on workload. High traffic? It scales up. Quiet hours? It scales down to zero, so you only pay for what you use. This eliminates manual monitoring and saves costs.

2. Point-in-Time Recovery: Protect against accidental data loss by reverting your database to a previous state. This feature provides peace of mind for developers and teams handling sensitive or critical data.
3. Low-Latency Access: Sub-10ms query response times ensure your applications remain fast and responsive, even for real-time use cases. Leveraging HTTP and WebSocket connections, Neon ensures smooth performance across all scales.
4. Instant Branching: Easily create isolated database copies for testing, development, or experimentation. These branches use minimal storage and don’t impact the main database, offering a quick way to work in sandbox environments.

These features collectively make Neon a versatile option for database management, particularly for teams aiming to save costs and improve efficiency while scaling their applications.

Things to Keep in Mind When Using Neon.tech

Just like any other serverless architecture, Neon.tech also has a few considerations to note before getting started:

1. Cold Start Latency: Be aware of potential cold start delays when resources are paused and need to be reactivated. While Neon minimizes these delays, they might still impact infrequent workloads. For critical tasks, consider configuring continuous operation to keep resources active.
2. Understanding Your Workload: Neon excels in environments with variable workloads. If your application has consistent, high-demand traffic, you may want to analyze whether the cost benefits of serverless scaling outweigh the overhead.
3. Compatibility with Tools: Neon is fully compatible with PostgreSQL drivers like psycopg2 and integrates well with popular tools like Prisma, Vercel, and AWS Lambda. However, ensure your existing tools and workflows align with Neon's features.
4. Resource Management: Monitor your database usage and set appropriate configurations to prevent unexpected costs. Neon’s cost-efficiency relies on scaling to zero during idle periods, but careful setup ensures you make the most of its features.

Conclusion

As with any new technology, understanding where the product fits into your workflow is essential. It’s not just about adopting a trendy tool, it’s about solving specific problems and optimizing workflows. At Kubenine, we’ve seen firsthand how Neon.tech can help reduce costs while maintaining flexibility. For example, we use Neon.tech for most of our QA and staging environments of our customers where resources are only needed during deployments. By doing so, we’ve managed to cut our storage costs by up to 50%.

Neon.tech is not a one-size-fits-all solution, but it excels in scenarios that demand scalability, cost efficiency, and ease of use. If you’re looking for ways to optimize your database management and streamline development workflows, it’s definitely worth considering.

At Kubenine, our goal is to make developer’s lives simpler and more cost-effective. Follow us for more insights into tools that save time and resources, and feel free to reach out for detailed discussions about how these solutions can benefit your projects.