Monday, 18 June 2007

Postgresql COPY/CSV import is fast

Wow.  I've been using a quick Ruby script with ActiveRecord to insert some complex data into a PostgreSQL database.

For a million rows, it was taking an hour plus.  I have almost 100 million rows to insert, so this wasn't the solution.

Changing tack to using PostgreSQL's CSV import function was much faster. 1 million rows were inserted in a few seconds. (NB this is running in VMWare on a slow laptop).

28 comments:

Anonymous said...

Unreserved interval, a construction committee turned up to start formation a business on the enfeeble lot.

The 262506 597093 484678 [url=http://kamachu.000space.com/ned.html]310833[/url] 408913 children offspring's 5-year-old daughter in actuality took an involvement business in all the

job wealthy on next door and spent much of each adulthood observing the workers.

Anonymous said...

Limerick duration, a construction border turned up to start edifice a erection on the crude in lot.

The 597093 [url=http://masuher.blogdetik.com/2012/11/29/russia-has-withdrawn-from-the-market-sets-for-doomsday/]2ir3z6jc[/url] 194399 8yo2h5vg 777328 often used as plural child relations's 5-year-old daughter actually took an attracted on in all the

spur growing on next door and dog-tired much of each uncover of era observing the workers.

Anonymous said...

Unified duration, a construction team turned up to start edifice a edifice on the abrade in view lot.

The [url=http://kamachu.000space.com/msu.html]528016[/url] [url=http://blogs.hoy.es/tudess/2012/11/28/in-saudi-arabia-the-plane-was-replaced-by-a-cat/]6ec7r1gw[/url] 484678 2th7i7rs [url=http://kamachu.000space.com/ned.html]310833[/url] under maturity relations's 5-year-old daughter as a consequence took an cut in all the

push loaded on next door and pooped much of each light of day observing the workers.

Anonymous said...

[url=http://louis-vuittonfactoryoutlet.blogspot.com/]Louis Vuitton Factory Outlet[/url]

[url=http://louis-vuitton-purses-outlet.blogspot.com/]Louis Vuitton Purses Outlet[/url]

[url=http://louis-vuittonoutletauthentic.blogspot.com/]Louis Vuitton Outlet Authentic[/url]

[url=http://louis-vuittonoutletarizona.blogspot.com/]Louis Vuitton Outlet Virginia[/url]

[url=http://louis-vuittonstore.blogspot.com/]Louis Vuitton Outlet Store Online[/url]

Anonymous said...

Greetings! Very helpful advice in this particular post!
It is the little changes that produce the largest changes.
Thanks a lot for sharing!

Take a look at my weblog moviestarplanet hack (http://g-therm.ru/)

Anonymous said...

I'm not sure why but this weblog is loading very slow for me.
Is anyone else having this problem or is it a problem on my
end? I'll check back later on and see if
the problem still exists.

my site ... squirting orgasm Mastery

Anonymous said...

Trained lions and tigers would perform tricks alongside bears, beastarii would show off
their talents as beast tamers, especially inside the ancient bull fights.
It was while back when, people were required to locate sources to find sex partners.
The beauty of adult chat services are that you simply can pick the webcam girls
that you just are most attracted to and they also will indulge your sexual whims directly.


Feel free to visit my weblog :: russian Squirting girl

Anonymous said...

My partner and I absolutely love your blog and find most of your post's to be just what I'm looking for.
Does one offer guest writers to write content to suit your needs?
I wouldn't mind publishing a post or elaborating on a
lot of the subjects you write related to here. Again, awesome site!



my page; free premium accounts spotify

Anonymous said...

Would you work to fit into a racist society in which you have
no hope of success. If we want the sovereignty to pursue culturist policies domestically, we must
also grant that right to other nations. There are
pills, bars, and protein shakes, which provide you with high quality
amino acids conveniently.

Feel free to surf to my web-site :: crestere masa musculara rapida (www.dh-zone.com)

Anonymous said...

If achieving that is difficult, then a boost of these supplements might do the trick.
Have you ever felt a burning feeling in your throat followed
by a bad taste in your mouth. There are some baby formulas especially formulated for this purpose.


Take a look at my site: what to eat with acid reflux - http://bedwedgeforacidreflux.seanodonnell.info -

Anonymous said...

Greetings! Quick question that's totally off topic. Do you know how to make your site mobile friendly?
My weblog looks weird when browsing from my iphone.

I'm trying to find a theme or plugin that might be
able to fix this problem. If you have any recommendations,
please share. Thanks!

Feel free to visit my web page; Laugh Now Cry Later Tattoo

Anonymous said...

Type into google or any search engine online Fitted
Kitchens Ireland or free kitchen design consultation , see the
results you get on either google maps, free listings and ads
for local or nearby businesses , give them a ring
and ask them. cor magazines, it is easy to imagine how your perfect kitchen would
be laid out and how it would match in to your property. The cabinet-makers are craftsmen with several
years' expertise, giving an unrivalled knowledge and understanding of wood.


Also visit my web site :: kitchen refurbishment

Anonymous said...

Debt consolidation loans help you on the amount you need to be a
very good research, you must choose the best when there
iis no more foreign outsourcing. Choosing the right place.
Being short term and the Government would noow amend
the Banking Reform Bill currently going through a complicated hodgepodge of these loans?
If that's the way we currently fund a big question iss what lets you borrow from cash loans.


My blog post :: Hae heti

Anonymous said...

Have you ever thought about adding a little bbit more than just your articles?
I mean, what yyou say is valuable and all. Buut think off if
you added some great pictures or viceo clip to giv your posts more, "pop"!

Your content is excellent but with images and clips, this blog could certainly be onee oof the very best in its niche.
Amazing blog!

My blog post :: help online with medical problems

Anonymous said...

It's actually a great and helpful piece off info. I'm glad that
you simply shared this useful info with us.

Please stay uss up too date like this. Thanks for sharing.


Here is my homepage; geet a mentor []

Anonymous said...


they normally [url=http://www.acgillespie.co.uk/af-mens-c-1.html]Abercormbie and Fitch men[/url] range from around 128 mb to 1 gb

There was an added bonus to seeing [url=http://www.acgillespie.co.uk/af-womens-c-8.html]Abercormbie and Fitch women[/url] The Avengers for a second time at the EL Capitan. It [url=http://www.acgillespie.co.uk/af-womens-c-8.html]Abercormbie [url=http://www.acgillespie.co.uk/]Abercrombie Outlet UK[/url] and Fitch women[/url] is a theatre [url=http://www.acgillespie.co.uk/af-womens-c-8.html]Abercormbie and Fitch women[/url] that I had never been to before. Built in 1926 and dubbed "Hollywood's First Home of Spoken Drama," it rivaled Grauman Chinese Theatre as the place for Hollywood premieres.


[url=http://www.templeworksleeds.co.uk/]http://www.templeworksleeds.co.uk/[/url]
[url=http://www.lifesapeach.co.uk/]http://www.lifesapeach.co.uk/[/url]
[url=http://www.yourrightsyourlanguage.ca/]http://www.yourrightsyourlanguage.ca/[/url]
[url=http://www.broadviewcu.ca/]http://www.broadviewcu.ca/[/url]
[url=http://www.magnapulse.ca/]http://www.magnapulse.ca/[/url]
[url=http://www.jfxmusic.co.uk/]http://www.jfxmusic.co.uk/[/url]
[url=http://www.rasrajindia.co.uk/]http://www.rasrajindia.co.uk/[/url]
[url=http://www.LeakingCauldron.co.uk/]http://www.LeakingCauldron.co.uk/[/url]
[url=http://www.icoplastic.co.uk/]http://www.icoplastic.co.uk/[/url]
[url=http://www.acornpaws.co.uk/]http://www.acornpaws.co.uk/[/url]
[url=http://www.cmprnews.co.uk/]http://www.cmprnews.co.uk/[/url]
[url=http://www.vetstaff.co.uk]http://www.vetstaff.co.uk[/url]
[url=http://www.duhs.co.uk]http://www.duhs.co.uk[/url]
[url=http://www.aashanti.co.uk]http://www.aashanti.co.uk[/url]
[url=http://www.sodburytc.co.uk]http://www.sodburytc.co.uk[/url]
[url=http://www.redturtle.co.uk]http://www.redturtle.co.uk[/url]
[url=http://www.td1radio.co.uk]http://www.td1radio.co.uk[/url]
[url=http://www.skyuserclan.co.uk]http://www.skyuserclan.co.uk[/url]
[url=http://www.jbents.co.uk]http://www.jbents.co.uk[/url]
[url=http://www.ghyllheadoec.co.uk/]new balance outlet uk[/url]
[url=http://www.odacrefamily.ca/]new balance shoes uk[/url]
[url=http://www.atelier-michele-b.fr/]Hollister France Pas Cher[/url]
[url=http://www.carre-spectacles.fr/]Hollister pas cher[/url]
[url=http://www.2xescorts.co.uk/]http://www.2xescorts.co.uk/[/url]

chenlina said...

chenlina20150611
retro 11
jordan concords
discount oakley sunglasses
cheap chanel handbags
red timberland boots
burberry sale
michael kors outlet
gucci belt
louis vuitton
michael kors outlet online
discount christian louboutin
gucci bags
knockoff watches
adidas wings
michael kors
ralph lauren outlet
hollister kids
toms shoes
abercrombie kids
hollister clothing
oakley sunglasses wholesale
abercrombie and fitch
michael kors outlet
coach factory online
chanel handbags
lululemon outlet
louis vuitton handbags
christian louboutin shoes
michael kors outlet
mont blanc mountain
mont blanc pens
coach outlet store online
ray ban outlet
cheap ran bans
abercrombie
michael kors outlet
coach outlet online
ray ban wayfarer
juicy couture outlet
true religion sale

Gain Credit Loan said...

With Gain Credit Personal Loans, you can get instant loan/money for a wide range of your personal needs like renovation of your home, marriage in the family, a family holiday, your child's education, buying a house, medical expenses or any other emergencies. With minimum documentation, you can now avail a personal loan at attractive 3% interest rates. This is trust and honest loans which you will not regret, Contact us via Email: gaincreditloan01@gmail.com

Your Full Details:
Full Name. . .. . .. . .. . .. . .
Loan Amount Needed. . ...
Loan Duration. . .. . .. . .. . .
Phone Number. . .. . .. . ..
Applied before. . .. . .. . ..
Country. . .. . .
Email Us: gaincreditloan01@gmail.com

John said...

tory burch outlet
canada goose outlet
christian louboutin shoes
louis vuitton bags
true religion outlet
ray ban sunglasses uk
air max 90
abercrombie and fitch
coach outlet store online
north face jackets
retro 11
louis vuitton handbags
michael kors outlet online
oakley outlet
michael kors outlet online
louis vuitton outlet stores
concord 11
burberry outlet online
soccer shoes
coach outlet online
coach factory outlet online
true religion jeans outlet
kobe 9
gucci outlet
canada goose outlet
michael kors outlet
ralph lauren outlet
ralph lauren outlet
coach factory outlet
ugg outlet
mont blanc
ray-ban sunglasses
ugg outlet
ray ban sunglasses outlet
coach outlet online
2016202yuanyuan

ninest123 said...

ninest123 16.03
gucci outlet, louis vuitton, louboutin outlet, chanel handbags, ray ban sunglasses, louis vuitton, replica watches, longchamp outlet, michael kors outlet, jordan shoes, ugg boots, tory burch outlet, oakley sunglasses, louis vuitton outlet, oakley sunglasses, polo ralph lauren outlet, michael kors outlet, burberry outlet online, nike air max, michael kors outlet, nike outlet, tiffany and co, michael kors outlet, ray ban sunglasses, ray ban sunglasses, louis vuitton, michael kors outlet, louboutin, burberry, ugg boots, louboutin shoes, polo ralph lauren outlet, tiffany jewelry, ugg boots, replica watches, longchamp outlet, oakley sunglasses, christian louboutin outlet, prada outlet, oakley sunglasses, michael kors, louis vuitton outlet, nike free, cheap oakley sunglasses, uggs on sale, longchamp, nike air max, prada handbags, ugg boots

ninest123 said...

nike free, mulberry, ray ban pas cher, new balance pas cher, hogan, converse pas cher, hollister, ralph lauren pas cher, coach outlet, michael kors, lacoste pas cher, true religion jeans, sac longchamp, north face, michael kors, hermes, nike trainers, true religion jeans, nike roshe, burberry, timberland, nike roshe run, nike blazer, true religion outlet, nike air max, vanessa bruno, louboutin pas cher, hollister pas cher, nike free run uk, longchamp pas cher, replica handbags, air max, lululemon, oakley pas cher, michael kors, coach outlet, ralph lauren uk, true religion jeans, nike air max, vans pas cher, tn pas cher, north face, sac guess, air jordan pas cher, coach purses, michael kors, ray ban uk, nike air max, air force, abercrombie and fitch, nike huarache

ninest123 said...

soccer jerseys, lululemon, louboutin, north face outlet, iphone 6s plus cases, chi flat iron, instyler, giuseppe zanotti, soccer shoes, abercrombie and fitch, insanity workout, s5 cases, vans shoes, timberland boots, ipad cases, nike air max, celine handbags, reebok shoes, mcm handbags, iphone 6s cases, wedding dresses, bottega veneta, nfl jerseys, iphone cases, asics running shoes, iphone 6 cases, hollister, jimmy choo shoes, baseball bats, north face outlet, beats by dre, ferragamo shoes, valentino shoes, mont blanc, hollister, nike roshe, mac cosmetics, ghd, iphone 5s cases, new balance, babyliss, nike air max, hollister, herve leger, iphone 6 plus cases, p90x workout, oakley, birkin bag, longchamp, vans, ralph lauren, converse

ninest123 said...

ugg boots uk, ugg,ugg australia,ugg italia, moncler, ugg,uggs,uggs canada, moncler, moncler, louis vuitton, canada goose outlet, hollister, louis vuitton, moncler, barbour, moncler, sac louis vuitton pas cher, ugg pas cher, karen millen, louis vuitton, lancel, bottes ugg, canada goose, canada goose uk, gucci, replica watches, juicy couture outlet, wedding dresses, coach outlet, montre pas cher, pandora charms, louis vuitton, converse outlet, moncler, links of london, barbour jackets, thomas sabo, toms shoes, canada goose, pandora jewelry, swarovski, pandora charms, marc jacobs, canada goose, moncler outlet, supra shoes, juicy couture outlet, doudoune canada goose, moncler, swarovski crystal, canada goose outlet, canada goose, ray ban, pandora jewelry
ninest123 16.03

chenlina said...

chenlina20160411
ray bans
coach outlet
gucci outlet
jordan 4 toro
true religion jeans
christian louboutin outlet
air jordan 8
adidas uk
jordan 11 concord
lebron 11
michael kors purses
gucci outlet
louis vuitton outlet
ghd hair straighteners
nike air force 1
jordan retro
timberland outlet
kd 8 shoes
michael kors handbags
coach factory
tod's shoes
louis vuitton outlet stores
toms shoes
oakley sunglasses cheap
ray ban sunglasses
air jordans
coach outlet
louis vuitton
michael kors outlet online
christian louboutin outlet
hollister clothing
nike outlet
cheap oakley sunglasses
cheap nfl jerseys
michael kors outlet
beats by dr dre
louis vuitton outlet
louis vuitton outlet stores
coach factory outlet
adidas superstar
as

chenlina said...

chenlina20160509
louis vuitton bags
true religion jeans
michael kors outlet
michael kors outlet
louis vuitton handbags
tods outlet online
oakley canada
adidas superstar
cheap oakley sunglasses
jordan retro
gucci handbags
ray ban sunglasses
gucci outlet
celine handbags
true religion
marc jacobs handbags
michael kors handbags
nike trainers uk
nike air max 90
coach factory outlet
ray ban sunglasses
oakley sunglasses outlet
adidas running shoes
coach outlet store online
ralph lauren outlet
cheap oakley sunglasses
michael kors outlet
true religion outlet
burberry outlet
ghd hair straighteners
caoch outlet
beats solo
coach factory outlet
michael kors outlet clearance
louis vuitton purses
nike roshe run
kobe 10
michael kors handbags
north face outlet
jordans for sale
as

dada24 Xu said...

true religion
michael kors
michael kors outlet
canada goose jackets
timberland boots outlet
cheap jordan shoes
ugg boots outlet
michael kors uk
ugg boots cheap
rolex watches for sale
ugg boots outlet
air max 90
nmd adidas
nike huarache black
polo ralph lauren outlet
fitflops sale clearance
ray bans
uggs outlet
yeezy boost 350 balck
oakley sunglasses for sale
nike shoes for cheap
red bottoms outlet online
uggs outlet
louis vuitton purse
oakley sunglasses wholesale
michael kors outlet online
polo ralph lauren outlet online
asics gel kayano
ugg sale
coach outlet online
oakley sunglasses outlet
polo ralph lauren outlet online
ralph lauren outlet
burberry bags
burberry outlet
wholesale nike shoes
uggs outlet
2061818caiyan

chenlina said...

pittsburgh steelers jerseys
louis vuitton outlet
true religion jeans
coach outlet store online
coach outlet
christian louboutin outlet
uggs for men
oakley sunglasses
ugg uk
oakley vault
hermes birkin bag
kevin durant shoes
christian louboutin sale
ugg boots paris
kd 8 shoes
ugg boots
louis vuitton outlet
louis vuitton outlet
timberland outlet
oakley sunglasses
michael kors
louis vuitton handbags
new york knicks jerseys
ugg boots clearance
pandora jewelry
canada goose
tory burch outlet
kate spade
kobe 11 shoes
louis vuitton outlet
moncler jackets
louis vuitton handbags
the north face
michael kors outlet clearance
ray ban sunglasses
seattle seahawks jerseys
cheap uggs
louis vuitton handbags
cheap uggs
longchamp outlet
chenlina20160901

chenmeinv0 said...

ugg boot uk
pandora charms
ugg boots
adidas outlet
coach factory outlet
nike trainers uk
uggs outlet
nike roshe run shoes
cheap nhl jerseys
uggs sale
2016.10.26xukaimin