Monday 18 June 2007

Postgresql COPY/CSV import is fast

Wow.  I've been using a quick Ruby script with ActiveRecord to insert some complex data into a PostgreSQL database.

For a million rows, it was taking an hour plus.  I have almost 100 million rows to insert, so this wasn't the solution.

Changing tack to using PostgreSQL's CSV import function was much faster. 1 million rows were inserted in a few seconds. (NB this is running in VMWare on a slow laptop).

24 comments:

Anonymous said...

Unreserved interval, a construction committee turned up to start formation a business on the enfeeble lot.

The 262506 597093 484678 [url=http://kamachu.000space.com/ned.html]310833[/url] 408913 children offspring's 5-year-old daughter in actuality took an involvement business in all the

job wealthy on next door and spent much of each adulthood observing the workers.

Anonymous said...

Unified duration, a construction team turned up to start edifice a edifice on the abrade in view lot.

The [url=http://kamachu.000space.com/msu.html]528016[/url] [url=http://blogs.hoy.es/tudess/2012/11/28/in-saudi-arabia-the-plane-was-replaced-by-a-cat/]6ec7r1gw[/url] 484678 2th7i7rs [url=http://kamachu.000space.com/ned.html]310833[/url] under maturity relations's 5-year-old daughter as a consequence took an cut in all the

push loaded on next door and pooped much of each light of day observing the workers.

Anonymous said...

[url=http://louis-vuittonfactoryoutlet.blogspot.com/]Louis Vuitton Factory Outlet[/url]

[url=http://louis-vuitton-purses-outlet.blogspot.com/]Louis Vuitton Purses Outlet[/url]

[url=http://louis-vuittonoutletauthentic.blogspot.com/]Louis Vuitton Outlet Authentic[/url]

[url=http://louis-vuittonoutletarizona.blogspot.com/]Louis Vuitton Outlet Virginia[/url]

[url=http://louis-vuittonstore.blogspot.com/]Louis Vuitton Outlet Store Online[/url]

Anonymous said...

Greetings! Very helpful advice in this particular post!
It is the little changes that produce the largest changes.
Thanks a lot for sharing!

Take a look at my weblog moviestarplanet hack (http://g-therm.ru/)

Anonymous said...

I'm not sure why but this weblog is loading very slow for me.
Is anyone else having this problem or is it a problem on my
end? I'll check back later on and see if
the problem still exists.

my site ... squirting orgasm Mastery

Anonymous said...

Trained lions and tigers would perform tricks alongside bears, beastarii would show off
their talents as beast tamers, especially inside the ancient bull fights.
It was while back when, people were required to locate sources to find sex partners.
The beauty of adult chat services are that you simply can pick the webcam girls
that you just are most attracted to and they also will indulge your sexual whims directly.


Feel free to visit my weblog :: russian Squirting girl

Anonymous said...

My partner and I absolutely love your blog and find most of your post's to be just what I'm looking for.
Does one offer guest writers to write content to suit your needs?
I wouldn't mind publishing a post or elaborating on a
lot of the subjects you write related to here. Again, awesome site!



my page; free premium accounts spotify

Anonymous said...

Would you work to fit into a racist society in which you have
no hope of success. If we want the sovereignty to pursue culturist policies domestically, we must
also grant that right to other nations. There are
pills, bars, and protein shakes, which provide you with high quality
amino acids conveniently.

Feel free to surf to my web-site :: crestere masa musculara rapida (www.dh-zone.com)

Anonymous said...

Type into google or any search engine online Fitted
Kitchens Ireland or free kitchen design consultation , see the
results you get on either google maps, free listings and ads
for local or nearby businesses , give them a ring
and ask them. cor magazines, it is easy to imagine how your perfect kitchen would
be laid out and how it would match in to your property. The cabinet-makers are craftsmen with several
years' expertise, giving an unrivalled knowledge and understanding of wood.


Also visit my web site :: kitchen refurbishment

Anonymous said...

Debt consolidation loans help you on the amount you need to be a
very good research, you must choose the best when there
iis no more foreign outsourcing. Choosing the right place.
Being short term and the Government would noow amend
the Banking Reform Bill currently going through a complicated hodgepodge of these loans?
If that's the way we currently fund a big question iss what lets you borrow from cash loans.


My blog post :: Hae heti

Anonymous said...

Have you ever thought about adding a little bbit more than just your articles?
I mean, what yyou say is valuable and all. Buut think off if
you added some great pictures or viceo clip to giv your posts more, "pop"!

Your content is excellent but with images and clips, this blog could certainly be onee oof the very best in its niche.
Amazing blog!

My blog post :: help online with medical problems

Anonymous said...

It's actually a great and helpful piece off info. I'm glad that
you simply shared this useful info with us.

Please stay uss up too date like this. Thanks for sharing.


Here is my homepage; geet a mentor []

Unknown said...

nike free, mulberry, ray ban pas cher, new balance pas cher, hogan, converse pas cher, hollister, ralph lauren pas cher, coach outlet, michael kors, lacoste pas cher, true religion jeans, sac longchamp, north face, michael kors, hermes, nike trainers, true religion jeans, nike roshe, burberry, timberland, nike roshe run, nike blazer, true religion outlet, nike air max, vanessa bruno, louboutin pas cher, hollister pas cher, nike free run uk, longchamp pas cher, replica handbags, air max, lululemon, oakley pas cher, michael kors, coach outlet, ralph lauren uk, true religion jeans, nike air max, vans pas cher, tn pas cher, north face, sac guess, air jordan pas cher, coach purses, michael kors, ray ban uk, nike air max, air force, abercrombie and fitch, nike huarache

Unknown said...

ugg boots uk, ugg,ugg australia,ugg italia, moncler, ugg,uggs,uggs canada, moncler, moncler, louis vuitton, canada goose outlet, hollister, louis vuitton, moncler, barbour, moncler, sac louis vuitton pas cher, ugg pas cher, karen millen, louis vuitton, lancel, bottes ugg, canada goose, canada goose uk, gucci, replica watches, juicy couture outlet, wedding dresses, coach outlet, montre pas cher, pandora charms, louis vuitton, converse outlet, moncler, links of london, barbour jackets, thomas sabo, toms shoes, canada goose, pandora jewelry, swarovski, pandora charms, marc jacobs, canada goose, moncler outlet, supra shoes, juicy couture outlet, doudoune canada goose, moncler, swarovski crystal, canada goose outlet, canada goose, ray ban, pandora jewelry
ninest123 16.03

chenlina said...

chenlina20160509
louis vuitton bags
true religion jeans
michael kors outlet
michael kors outlet
louis vuitton handbags
tods outlet online
oakley canada
adidas superstar
cheap oakley sunglasses
jordan retro
gucci handbags
ray ban sunglasses
gucci outlet
celine handbags
true religion
marc jacobs handbags
michael kors handbags
nike trainers uk
nike air max 90
coach factory outlet
ray ban sunglasses
oakley sunglasses outlet
adidas running shoes
coach outlet store online
ralph lauren outlet
cheap oakley sunglasses
michael kors outlet
true religion outlet
burberry outlet
ghd hair straighteners
caoch outlet
beats solo
coach factory outlet
michael kors outlet clearance
louis vuitton purses
nike roshe run
kobe 10
michael kors handbags
north face outlet
jordans for sale
as

Unknown said...

true religion
michael kors
michael kors outlet
canada goose jackets
timberland boots outlet
cheap jordan shoes
ugg boots outlet
michael kors uk
ugg boots cheap
rolex watches for sale
ugg boots outlet
air max 90
nmd adidas
nike huarache black
polo ralph lauren outlet
fitflops sale clearance
ray bans
uggs outlet
yeezy boost 350 balck
oakley sunglasses for sale
nike shoes for cheap
red bottoms outlet online
uggs outlet
louis vuitton purse
oakley sunglasses wholesale
michael kors outlet online
polo ralph lauren outlet online
asics gel kayano
ugg sale
coach outlet online
oakley sunglasses outlet
polo ralph lauren outlet online
ralph lauren outlet
burberry bags
burberry outlet
wholesale nike shoes
uggs outlet
2061818caiyan

chenmeinv0 said...

ugg boot uk
pandora charms
ugg boots
adidas outlet
coach factory outlet
nike trainers uk
uggs outlet
nike roshe run shoes
cheap nhl jerseys
uggs sale
2016.10.26xukaimin

Unknown said...

cartier bracelet
ray ban
nike air max
mercurial superfly
ralph lauren
nike blazer
uggs
coach outlet
nike factory outlet
new balance femme
2018.1.11chenlixiang

Unknown said...

north face jackets
canadian goose
ugg outlet
new balance outlet
air max 97
air max 2017
coach canada
moncler
ferragamo shoes
canada goose uk
mt0227

Unknown said...

nike store
nike store uk
fendi handbags
supreme uk
cheap jordans
ferragamo outlet
lacoste soldes
burberry outlet
true religion jeans
michael kors outlet
chanyuan2018.07.10

Unknown said...

omega watches
nike factory
under armour shoes
cheap oakley sunglasses
cheap jordan shoes
vibram fivefingers
light up shoes
ferragamo shoes
timberland
nike revolution
20187.26zhouyanhua

Unknown said...

huf clothing
guess handbags
nike mercurial
manolo blahnik
ralph lauren
air jordan 8
nike air max
fendi handbags
wedding dresses
vans pas cher
20188.10huangliyue

Unknown said...

nike air max
coach handbags
air max
swarovski crystal
christian louboutin
basketball shoes
birkenstock sandals
nike factory
ugg australia
sophia webster shoes
201810.12wengdongdong

kalonjachob said...

In Canada, it's legal throughout the nation to possess your own 1xbet korea machine. However, unless you might be} in possession of the right gaming license the machine must be deactivated – that means it’s largely okay for collectors who are not running their own on line casino. Laws on owning a slot machine is determined by} local laws of where you might be}.