PostgreSQL

First meeting of the Austin PUG, May 6th, 6PM

2008-04-26T16:05:33Z

Part of Austin's Geek culture? Work for a company using an open source database? Interested in Keeping Postgres Weird?

Then join us at the first meeting of the Austin Postgres User's Group on Tuesday, May 6th at 6PM!

The rough agenda will be:
6:00 - 6:30 Meet 'n greet
6:30 - 7:15 Discuss goals for the AustinPUG
7:15 - 7:45 Presentation: What's new it 8.3?
7:45 - 8:00 Wrap-up

The meeting will be held at Sun's offices in Riata:

Sun Microsystems
Building 8 - Longhorn Conference Room
5300 Riata Park Ct
Austin, TX 78727
Map

We will have to register everyone who is attending as a visitor; to make this as efficient as possible, please RSVP to austinpug@decibel.org. Oh, and there's one more reason to register...

FREE PIZZA!

I'll be ordering from Mangia's; please let me know if you'd rather chow down on spinach, pepperoni, or Chicago style (or if you really can't eat any of the above...)

During DB development it became clear, that using a version control system (VCS) for sources ...

2008-01-12T14:02:57Z

... in PlPgSQL (and might be for table definitions as well) is rather highly preferable. However, I haven't found a suitable tool yet. It seems that the simpliest way is to dump a DB with Postgresql's pg_dump and then put the source under VCS, but this is poorly satisfactory. I deem the better solution would be a tool ``decomposing'' this dump into a chunk-files, containing only one function definition perhaps with other needed entities. Yeah, this is not too hard to write by myself, but if there's something better (or at least already written) available, I'd use it. :-)

database connecton pooling

2007-10-15T04:20:06Z

What tools exist for db connection pooling for postgresql?
Does one use something frmo postgresql or something from say perl?

grant select to * on user

2007-09-10T10:30:39Z

Hello!

How do I grant select privilege on all tables in a database to some user?

UPDATE FOR DUMMIES: THIS IS A POSTGRESQL COMMUNITY.

Advanced working with IP addresses: Patricia

2007-08-15T05:35:01Z

Hello!

I'm working on storing many different logs in Postgresql database, and found a non-trivial task.

Is there any good ways to find if an address belongs to a (large) set of networks? Or I'd better use PL/Perl and Net::Patricia?

PL/SQL and int to interval conversion

2007-08-03T15:10:56Z

Hello!

How do I, in PL/SQL function, convert integer value to time interval? Integer specifies time interval, in milliseconds.

(I'm working on log parsing)

How to view database permissions

2007-08-01T01:47:56Z

I'm fairly new to PostgreSQL, coming from a background in MySQL and, to a far lesser extent, Oracle 9i.

I noticed that psql allows me to view all table permissions in a database using \dp or \z. I can't figure out, however, how to view any privilges granted by a GRANT ALL PRIVILEGES ON DATABASE x TO y. I'm sure there has to be a way, even if it's by querying the system tables/catalogs.

So... will anyone tell me how to view these types of privileges?

Some photos from PGDay 2007

2007-07-11T07:24:50Z

http://flickr.com/photos/8889549@N08/sets/72157600731834957/

For the full PGDay coverage you can refer to http://www.planetpostgresql.org

PGDay day one W00T!

2007-07-07T05:04:53Z

Ok, I'm tired, my legs hurts but I'm very very happy.

My PGDay started at 5 a.m. preparing last modification on slides of my mini courses.

The day started with first panic at 8.30 a.m., because a lot of people, more than we expecting, was at registration desk asking to be included in the first italian PostgreSQL Day.

My morning was very busy attending mini-courses about DBA base, advanced and just a little performance tuning talk on the veneziana room almost fullfilled with 40-50 people.

I'm very happy about my performance, some guy asked me many tecnical things and the Faunaly guys told me that my audience was very very happy.

I can't spend enough good words about PostgreSQL guys.

David Fetter was the first Postgresql that I've meet in florence, he gave us a lot of elephant pins, and pleased us staying at PLUG site. Thanks David w00t!

Josh Berkus it's fantastic, he speak very good italian, and he gave me a tequila bottle and a linux-freebsd t-shirt. Thank you Josh, sorry for my bad english.

I'm very happy to meet so cool guys, as dalibo guys (thank you Cedric someone told me that you have apreciate my talk).

The german guys are very cool.

Ok, first day was good, tomorrow I'll introduce Josh keynotes and then I'll be in the audience.

I'm looking forward to listen Simon Riggs PITR talk and meet Hans from Cybertec that just confirmed his talk tomorrow.

And this evening, we'll have a concert at PLUG, if you are in Prato, you are invited.

Grant question.

2007-06-06T17:42:26Z

Hi,

I have a user. let's call him "websitedev". I also have a database called "events" which was created by user "postgres". I have a php application that this user "websitedev" is able to connect to the database, the problem is it doesn't have permissions to access the tables.

grant all privileges on database events to websitedev with grant option;

But when I try to connect via the website application I am still getting.

Warning: pg_exec() [function.pg-exec]: Query failed: ERROR: permission denied for relation tablename in path/to/file.php on line 59

Ideas?

TIA....

Italian PostgreSQL Day 2007

2007-05-10T09:50:38Z

The PostgreSQL Day (aka PGDday) is a day of celebration. Celebration for PostgreSQL and, on a wider view, for the free software and open-source communities based in Italy and Europe.

The event (the first in Italy) will take place in Prato , Tuscany on July 6 and 7 2007, on the eve of the 21st anniversary of PostgreSQL, a project that was started on the 8th of July 1986, at the University of California, Berkeley.

The Italian PGDay 2007 is a chance for Italian and European users and developers of PostgreSQL to catch up, learn, build relationships, get to know each other and consolidate a real network of professionals that use this outstanding product for the daily management of relational and object databases.

Another fundamental goal for the event, is to promote the usage of PostgreSQL as a completely free tool for database management, a very competitive alternative to proprietary solutions.

Among the others, the most suitable audiences for the event (and the most suitable targets for PostgreSQL usage as well) are:

* government organisations
* schools and universities (for direct usage and educational purposes as well)
* small and middle size companies

PGDay is organised as a set of parallel talks, seminars, presentations, tutorials and practical workshops that will run throughout the day. Based on the target and the level of knowledge of the product, the happenings will be divided into:

* advanced technical level presentations
* basic technical level and use-case presentations

The event will be preceeded by a national and European initiative known as Road to PGDay 2007, whose aims are to promote PGDay throughout Italy and Europe by involving local free software communities such as LUGs.

More infos at: http://www.pgday.it/en

Great PostgreSQL DBA job!

2007-05-09T22:29:03Z

I hope you don't mind me posting this here. I am looking for experienced PostgreSQL DBAs (a Jr and a Sr level) for a really exciting position in Utah, in a company culture where you can work and play hard in a great team environment with challenging technical problems (like massive pageviews and transactions).
Skiing is optional.
You can read a bit more on my LJ blog and contact me by email if you are interested or have a buddy who is passionate about open source and life in general.

synching db's over modem / slip conn.

2006-06-16T11:04:29Z

Hello. I have N remote stations with postgres 7.4.6 (for data collecting). I need to perform periodic sychronization one MASTER station with N remote stations via slip connection. Please help me to find a simple solution of this problem. Thanks.

Networking issues

2006-03-29T07:27:06Z

Hi all, first post etc.

Lately I've been having some kind of problem with my PgSQL configuration and I'm trying to figure if it's my DB configuration or a problem with networking.

Basically, I added the following line to my hba.conf:

hostnossl all all 149.169.19.1/8 md5

I also have the default:

host all all 127.0.0.1/32 md5
.

At the same time, I changed my listen_addresses in postgresql.conf to '*'.

Ever since doing so, whenever I start up the application I'm working on (which uses the .Net sql provider) about half the time, I get the error: "Unable to read data from the transport connection: An existing connection was forcibly closed on the remote host," and the server log says: "[time] LOG: incomplete startup packet
[time] LOG: could not receive data from client: An operation was attempted on something that is not a socket."

The other half of the time, it works just like normal.

So, what did I break?

Database Migration

2006-03-22T15:17:31Z

Can anyone suggest a utility or a script to convert a MySQL database to a PostgreSQL database? I've done a few google searches, but I haven't found anything suitable.

Thanks!

reserved schema names?

2005-10-13T05:32:14Z

Anybody know what other reserved schema names there are besides 'pg_*'? I tried to:

mcb211=# create schema '2005';
ERROR:  syntax error at or near "'2005'" at character 15
LINE 1: create schema '2005';
                      ^

crash recovery

2005-09-08T16:32:20Z

PgSQL version: 7.3.x

There was FS crash and I was able to get data/base and data/pg_clog directories of pgsql installation. Is it possible to recover DBs data from this directories?

Will this work?
1. Create DBs with identical structure
2. Copy data/base directory over freshly created directories

postgresql @ 2005-08-13T03:55:00

2005-08-13T00:02:31Z

I faced a problem:

pgsql ver >= 8.0
table w/primary key (item_id, lang)
languages list, ordered by priority

needed:
effectively find the most convenient row (item_id, lang) for given item_id.

could someone give an advice?
what language facility is the most suitable?

Multiple Left Joins not obtaining all requested data

2005-08-12T17:52:13Z

I have a query that runs in MySQL... It's happy, it's joyous and it just works.

I have slightly changed the syntax of it so that it will work in Postgres. Postgres will not let me use the same formatting of the query because of the types of joins I'm doing.

Here are the details:

I have the following join, and in this join I am getting all of the data except that which joins the pa to the dao. When I try to join it using a left join, i get all of the data except this table. When I use a right join, I get nothing at all. If I make this a seperate join to dal (rather than nested as it is) I have no connection/path to the dao table because of the way that the postgres optimizer works, and I have to use another alias.

Can you think of something I'm missing given the scenario? The query currently looks like this:

SELECT
    -- a bunch of columns here
    dr.profile_id

FROM
    dr,
    da,
    dal
    LEFT JOIN (  doo
        LEFT JOIN ( dao
            LEFT JOIN pa
            ON ( pa.dao_id = dao.dao_id ))  -- the problem area is here.
                                            -- There are cases where there are no related doo values set but
                                            -- I'm not sure how to write this better
        ON ( doo.dao_id = dao.dao_id
            OR pa.dal_id = doo.dal_id ))
    ON ( dal.dal_id = doo.dal_id
        OR dal.dal_id = pa.dal_id )

WHERE dr.dr_id = doo.dr_id
    AND dr.dr_id = '1'
    AND da.da_id = dal.da_id

ORDER BY da.name

On the other hand, the MySQL query that works is as follows:

SELECT 
    -- alot of fields here
    dr.profile_id
FROM da, 
    dr,
    dal
        LEFT JOIN doo ON ( 
            dal.dal_id = doo.dal_id 
            AND doo.dr_id = dr.dr_id )
        LEFT JOIN dao ON ( doo.dao_id = dao.dao_id) -- joins with doo
        LEFT JOIN pa ON ( 
            dal.dal_id = pa.dal_id )

WHERE dr.device_range_id = '4'
    AND pa.p_id = dr.p_id 
    AND da.da_id = dal.da_id
    AND ( pa.pa_id IS NOT NULL 
             OR doo.doo_id IS NOT NULL)

ORDER BY da.name

I have been working on this for a little too long now, and could really use a little help on this.

Thanks!

postgresql @ 2005-08-05T14:22:00

2005-08-05T11:23:08Z

Prompt any free-of-charge hosting with support PHP+PostgreSQL.
Thanks.

Problems with simple query: performace is poor :(

2005-07-06T07:48:28Z

I have simple table (it is smallest example, which shows problem):

CREATE TABLE objects
(
  id serial NOT NULL,
  otyp text NOT NULL,
  prop text,
  CONSTRAINT solid_objects_pkey PRIMARY KEY (id)
) 
WITHOUT OIDS;
CREATE INDEX objects_otyp_idx ON objects USING btree (otyp);
CREATE INDEX objects_prop_idx ON objects USING btree (prop);

This table is filled with 100'000 records. 80'000 of these records have "otyp" set to 'track', other 20'000 have some other values. "prop" is random text from 10 to 100 characters.

I have three queries:

SELECT * FROM objects WHERE otyp = 'track' LIMIT 25

SELECT * FROM objects ORDER BY prop LIMIT 25

SELECT * FROM objects WHERE otyp = 'track' ORDER BY prop LIMIT 25

First and second queries are executed in 0.06 seconds (60ms). Third query takes 3.6 seconds to complete.

Is it Ok for PostgreSQL? Third query is fairly typical, IMHO, and it is very strange, that it is soooo long.

My platform is WinXP/SP2, iPIV-3.2Ghz(HT), 1Gb of RAM, HDD is Segate Barracuda 7200.7 SATA.

PostgreSQL instructed to use up to 512Mb of memory (instead of default 1Mb).

postgresql @ 2005-06-13T15:58:00

2005-06-13T13:04:47Z

Problem at installation PostgreSQL with the instruction --enable-nls='ru':
%./configure --enable-nls='ru'
...
configure: error: a gettext implementation is required for NLS

Why?

%whereis gettext

gettext:/usr/local/bin/gettext/usr/local/man/man1/gettext.1.gz/usr/ports/devel/gettext

%uname -a

FreeBSD 5.4-STABLE FreeBSD 5.4-STABLE *1: Sun Jun 12 00:48:36 UTC 2005 root @:/usr/src/sys/i386/compile/GENERIC i386

Thanks.

Moving crypt-style passwords from 7.1.3 to 8.0?

2005-04-05T14:48:18Z

Versions later than 7.2 no longer support passwd(8)-style password files to be specified in pg_hba.conf. The documentation for 8.0 says that I have to store user passwords in plaintext in pg_shadow if I use crypt as the auth-method in pg_hba.conf. Since I obviously don't know my users' plaintext passwords, and only have their crypt-hashes from the old passwd(8)-style file, how do I migrate these?

postgresql @ 2005-03-21T14:39:00

2005-03-21T22:49:50Z

I am trying to migrate from MySQL to PostgreSQL to take advantage of store proceedures, but I'm mystified as to how to set up reliable db replication.

In MySQL is it was easy to replicate the whole database (accounts included) between two servers. And if one server went down they would sync nicely. This let us do some load balancing and ensure we always had an up to date back-up server if the primary failed.

PostgreSQL doesn't seem as polished in this regard.

What I've found on the subject is this page:
http://www.infocopter.com/know-how/postgresql/replication/index.html

Unlike in MySQL, it seems I can't just make a table or a new db on a server and have it automatically replicated. I need to create them on both servers. And I need to put in special replication triggers in the db on the master server. It's annoying, but I can deal with that.

What concerns me is if the master goes down and new rows are inserted on a db on the slave server, they could conflict with a primary key on the master server when it comes back.

How can I set up a reliable replicated server pair, where if the master goes down, we can safely write to the slave and have the changes copied back to the master when it comes back?