Category Archives: postgres

postgres, postgresql, presentation, speaking , , , , , ,

OSCON: Postgres represent! And my links for Harder, Better, Faster, Stronger talk

I’m giving a couple talks at OSCON this year. The first is on Tuesday, 10:40am room C123: Harder, Better, Faster, Stronger: Postgres 9.1. The other is Mistakes were Made, Wednesday at 1:40pm in room D136.

My colleague Robert Treat is giving a Pro PostgreSQL workshop Wednesday at 1:40pm too, room 204. He’s also giving a Scalability Patterns talk at 4:20pm Tuesday. I’m sure his talks will be awesome. šŸ™‚

And here are the rest of the talks tagged with PostgreSQL.

Also remember — there’s a PgDay tomorrow at the Oregon Convention Center!

I’m pushing my examples for my 9.1 talk into a github repo. It should be populated with whatever I decide to use for the talk by Monday evening.

Building 9.1 for me on Mac OS X (leopard!) involved the following:


git tag -l | grep REL9_1
git checkout REL9_1_BETA2
./configure --with-perl --with-python --prefix=/opt/pg91beta2 --with-readline
make
make install

Normal caveats apply – you need X Code of a reasonably recent version, and a bunch of support libraries to make this happen. I haven’t rebuilt from scratch on OS X in a long time, but now I realize that maybe I aught to go through the pain and document this again.

But I digress!

I have a long list of resources for this talk and wanted to share. Probably in the slides for the talk, I’ll provide shortlinks so that people can pull them up and read instead of listening to me šŸ˜€

Here’s my links:

And if you’re wondering about the title, I took it from an great Daft Punk song that fans have created some epic videos of:

postgres, postgresql , , ,

PgCon 2011: PL/Summit notes

Thank you all who participated in the PL/Summit. We spent about 5 hours together for discussions about PLs, and then a few more hours at the pub.

Also, thank you to Dan who supported the meeting and provided pizza. And thanks to SPI for funding travel for several hackers that could not have made it to PgCon otherwise.

The rough notes from the meeting are at:

http://wiki.postgresql.org/wiki/PgCon_2011_PL_Summit
http://wiki.postgresql.org/wiki/PL_Features_Matrix

I put a few TODOs out there based on discussions, and for a reminder to myself to follow up with folks that had good ideas.

Here’s the TODOs:
* Publish code for PL/NULL – Tim
* Make a list of all the boilerplate code – Selena will send email to -hackers about it
* Set up a 1/2 day meeting at the next pgcon – Josh Berkus
* Set up a Skype session in a few months time to go over progress – Selena (Tim, Alvaro agreed to attend)
* Further discussion of DDL triggers – Jan Wieck
* Further discussion of permission system – Steve Singer
* Further discussion of per-statement config parameters for things like timezone – Jan Urbanski

postgres, postgresql , , , 3 Comments

PgCon Pub Track: Learning more about Synchronous Replication

So, we’re at the Pub and doing “create a billion tables” time trials with Jan Urbanski using Python and Josh Berkus using Perl.

We’re also hacking on a test framework the Slony developers have, specifically hacking with Steve Singer. What we discovered is that sync rep doesn’t wait for a WAL segment to be *replayed* before it returns. In the pg_stat_replication table, we see sent_location, write_location and flush_location synchronized, but not replay_location.

This makes sense from a database perspective, but may be surprising behavior for application developers. There are patches out there (according to what I just heard from Bernd) to make synchronous replication wait for replay on the slave, but it’s not certain when that will be committed. It definitely won’t be part of version 9.1.

I just wrote up configuration details from a database administrator’s perspective, and am planning on doing some additional work to make a highly condensed configuration tutorial for our main docs. We definitely need to explain this more clearly for users, who might be thinking of it more from an application perspective.

postgres, postgresql , , , , 1 Comment

Announcing Postgres Open

On behalf of the Postgres Open organizing committee, I’m pleased to share this announcement:

Postgres Open 2011, a conference for data innovators focused on disruption of the database industry through PostgreSQL, will take place September 14-16, 2011 at Chicago’s Westin Michigan Avenue hotel.

“PostgreSQLā€™s consistent addition of new features and enhancements, while remaining focused on reliability and performance, has provided myYearbook a solid foundation to create new and innovative applications,ā€ said Gavin Roy, CTO at myYearbook. ā€œWe are looking forward to the Postgres Open Conference as a venue to share, network, and learn innovative ways to leverage Postgres in our environment.”

Postgres Open, a community-organized, non-profit conference, addresses the breadth of PostgreSQL usage, from core database system design to enterprise database use. Inviting entrepreneurs and technologists on the leading edge of data management, the conference will focus on open source database innovation and changes in the database market. Postgres Open includes regular talks, keynotes and hands-on tutorials.

We’re pleased to announce that VMWare and EnterpriseDB are joining the conference as founding sponsors.

The theme of the inaugural conference is ā€œdisruption of the database industryā€. Topics will include new features in the latest version of PostgreSQL, use cases, product offerings and important announcements. Invited talks and presentations will cover many of the innovations in version 9.1, such as nearest-neighbor indexing, serializable snapshot isolation, and transaction-controlled synchronous replication. Vendors will also be announcing and demonstrating new products and services to enhance and extend PostgreSQL.

Postgres Open 2011’s main program (September 15-16) will be preceded by a day of intensive, half-day tutorials.

The Call For Papers for Postgres Open will open in late May.

Our program committee includes:
Robert Haas, Major Contributor, PostgreSQL committer,
Josh Berkus, Core Team member,
Greg Smith, Major Contributor to PostgreSQL and author of High
Performance PostgreSQL 9.0,
Gavin Roy, CTO of MyYearbook.com and
Selena Deckelmann, Major Contributor to PostgreSQL.

If you’d like to receive announcements as the conference progresses, please visit the website and add your email address to our list.

For information concerning sponsorship, please send email to sponsorship@postgresopen.org for a copy of our prospectus.

postgres, postgresql , ,

PgCon Day 1 – Cluster summit and catching up with folks

Yesterday, I spent my morning at the Clustering summit, catching up on what the cluster hackers have been up to for the last year. I was lucky enough to sit next to Jan Wieck and Kevin Grittner. You may remember Kevin from his work on serializable snapshot isolation.

There were some pretty awesome side conversations about where folks think work needs to be done next, and conflict resolution for multi- (or many-) master setups.

I gave a quick update on Bucardo 5, which had an alpha release last week, supports many-master and has has experimental support for non-Postgres targets. The first two targets are text and MongoDB.

The Postgres project has given the generic name “binary replication” to all the features like WAL shipping, streaming replication and synchronous replication. Simon Riggs also gave his update on these features at the Clustering Summit today. He observed that the 9.1 release is the culmination of 7 years of work on replication subsystems. Simon pointed out that synchronous replication is the best, and most obvious, use case for the binary replication at the core of Postgres. And also pointed out that he was quite pleased with the ultimate design.

For the afternoon, I spent some time with folks on the infrastructure team, giving Magnus well-deserved congratulations for his induction into -core, and meeting up with folks from all over at the Royal Oak and Keg, a reasonable steakhouse in town.

Looking forward to the developers meeting today!

postgres, postgresql , , , , ,

At PgCon 2011 – day 0

I wrote my review of synchronous replication over on Emmaā€™s Tech blog (It’ll probably be published mid-day Tuesday). Iā€™m visiting Ottawa this year on behalf of Emma, one of many great sponsors of Postgresā€™ yearly international developer conference, pgCon.

This week will be packed for me – attending the Clustering summit, the developers meeting, presenting about Emmaā€™s database systems, leading the lightning talks, and of course attending the many parties this week.

Because we are spread so far around the globe, pgCon is often our one chance to get together and really dig into problems in-person.

And, Iā€™m pulling together our first ever Procedural Language summit. With the new extension system, over 30 procedural languages implemented, and a ton of new features being added to existing PLs, I thought it was time PL developers should come together and have a chat. Iā€™ve still got a few details to work out before Saturday (sorry all that RSVPā€™d – final agenda coming soon!).

Iā€™m hoping to also have another, unrelated, announcement this Wednesday. Hopefully all the details come together!

Anyway, with that cliffhanger, Iā€™m off to get a good nightā€™s rest before the clustering summit tomorrow.

postgres, postgresql , , ,

9.1 beta 1 is out! Help us test.

Postgres released version 9.1 beta 1 today! This is a preview of 9.1, predicted to be available in the next 2-3 months, not a bugfix release for earlier versions of Postgres.

PostgreSQL 9.1 contains a huge volume of new features, possibly more any single release of PostgreSQL before. These features also include several innovations which PostgreSQL is the first database system to have. The most anticipated features in this version include:

  • Synchronous Replication
  • Per-column collations for multilingual databases
  • Unlogged Fast Tables
  • K-Nearest-Neighbor Indexing
  • Serializable Snapshot Isolation
  • Writeable Common Table Expressions
  • SE-Linux Integration
  • Extensions
  • SQL/MED attached tables

The PostgreSQL project now depends on you to test 9.1beta1 in order have a rapid and bug-free 9.1 release. If you are able to help with testing version 9.1, please see the Beta Testing HOWTO

Binary downloads are available, as is the source.

If you’d like to grab a copy of the latest from git, here is a quick set of instructions to compile 9.1beta1 from the git repo: 


git checkout REL9_1_BETA1
./configure --prefix=/opt/pg9.1beta1
make
sudo make install

And then to create a database: 

/opt/pg9.1beta1/bin/initdb -D mytestdb
/opt/pg9.1beta1/bin/pg_ctl -D mytestdb start

For a preview of features coming this fall, check out Depesz’s blog.

postgres, postgresql, speaking , , , 4 Comments

Two talks at MySQL Conf done! Slides…

Just finished my last talk. Slides are downloadable here, and also embedded after the break.

MySQL Conf – Managing Terabytes

Own it: Working with a changing open source community

The floor show is closed, so no more booth work tomorrow. I’ve had a great time here talking with people and seeing my colleagues in the PostgreSQL and MySQL community.

Looking forward to getting some hacking time in tomorrow and enjoying an evening connecting with people instead of working on slides. šŸ™‚

Continue reading →

postgres, postgresql , ,

At MySQL Conference: Day 1 preview

Today is the first day of regular sessions at MySQL Users Conference.

I’m particularly excited this year because we have 12 PostgreSQL talks, including a Plenary talk at 9:40am this morning about the state of PostgreSQL.

Today’s talks include Building Data Warehouses, An Introduction to PostGIS, Securing PostgreSQL from external attack, and Introduction to PostgreSQL configuration.

MySQL Users Conference is the largest open source database conference in the world. When so many changes are occurring inside the MySQL database community, our presence is critically important. Particularly that we have Bruce Momjian, Robert Haas, Jeff Davis, Josh Berkus and many others here. Thank you to everyone that’s contributing to the booth, the talks and engaging in conversations here.

We’re also having a PostgreSQL BoF this evening, in Ballroom B at 7pm! Please stop by.

postgres, postgresql , , , 3 Comments

Getting ready for the first PostgreSQL track at MySQL Users Conference!

Back in February, I blogged about all the sessions related to PostgreSQL at MySQL Users Conference this year.

My stickers just arrived:

Stop by the PostgreSQL booth during the MySQL Expo, or come to one of my talks if you’d like one.

I’m giving two – one is about Emma’s database systems and the problems with scaling huge schemas. And the other is a community talk about managing competing business and community interests inside of the Postgres community, and lessons that other open source communities can learn from our successes and failures.

We’re having a free Birds of a Feather session Tuesday, April 12 at 7pm at the Santa Clara Convention Center. Please stop by!