Importing 250k HH, causing computer problems

[tercet]

Hello

I recently had my main computer reformmatted, and I wanted to import previous HH on a postSQL db. Twice so far, I have tried importing the DB, I waited 4 hours, got impatient then turned my computer off. Each time its only imported about 60k hands before I turned computer off. After I turned it back on my computer has been a complete piece of shit, every minute it will freeze for 15seconds then go back to normal, freeze etc.

Are symptoms like this normal or what?

Tommorow I plan on giving my computer a 20 hour time frame to import the HH's without my interuppting my computer

[ptrack mike]

Twice so far, I have tried importing the DB, I waited 4 hours, got impatient then turned my computer off...

You shouldn't be doing this, because obviously you are corrupting your database every time. Be patient and let the import complete no matter how long it takes figuring PT2 should be able to import about 30,000 hands/hr. Also, make sure you aren't doing anything to slow down the import like using the auto-rate on import option:
viewtopic.php?f=30&t=1373

In the future if you are going to reformat just make a backup of your PostgreSQL database using the Utilities > PostgreSQL Database Functions... window. It's mush easier and faster to restore a database versus re-importing that many hands.

[tercet]

Okay, well whatever I did to my computer by stopping this screwed the hard drive up pretty bad. So I had to format again, so I will need to ask you guys for another PT code(4th in 2 weeks), you guys will really hate me now lol.

Anyways as I said Ill start the import tonight at midnight or so and wont touch till 5pm Monday, which gives it roughly 15 hours, which should be enough I hope.

[Guest]

Are you using the manual import button? I have recently re-created the database again and imported approx. 120k hands in about 31 minutes. And that was on a networked database, not even a local one. So I would say that importing 250k hands on a local computer with reasonable recent hardware should not take more then about an hour.

What I experienced once when I tried to import the histories via auto-import it took well over 13 hours and then not even the whole bunch was imported yet. Maybe you are trying the auto-import and not the manual one?

[ptrack pat]

Are you sure you didn't import those into a PT3 database? I would be shocked in PT2 importing 120K hands that quickly. I've never been able to get it to do much more than 30-40K hours.

[Guest]

Ahhhh, yes, you are right, sorry, wrong PT version :(

[tercet]

New error...

*********************************
PT Version: 2.17.02a
Error Date: 07/18/2008 20:12
Database Error: 7
Error Text: SQLSTATE = XX000
ERROR: could not read block 5540 of relation 1663/16403/16565: Invalid argument;
Error while executing the query

No changes made to database.

INSERT INTO game_players ( player_id, seat_number, game_id, button, hole_card_1, hole_card_2, suited, pre_flop_bet, flop_bet, turn_bet, river_bet, total_bet, total_won, played_hand, final_hand, hand_rank_id, hole_cards, card_order1, card_order2, card_order3, connector_hand, pair_hand, won_hand, session_id, off_the_button, number_of_players, big_blind_n, small_blind_n, pre_flop_raise_n, flop_raise_n, flop_ck_raise_n, turn_bet_raise_n, turn_bet_ck_raise_n, river_bet_raise_n, river_bet_ck_raise_n, went_to_showdown_n, saw_flop_n, saw_flop_blind_n, attempted_steal, chance_to_steal, steal_attempted, folded_to_steal_attempt, raised_first_pf, vol_put_money_in_pot, limp_with_prev_callers, ppossible_actions, pfold, pcheck, praise, pcall, limp_call_reraise_pf, pfr_check, pfr_call, pfr_fold, pfr_bet, pfr_raise, folded_to_river_bet, fpossible_actions, ffold, fcheck, fbet, fraise, fcall, tpossible_actions, tfold, tcheck, tbet, traise, tcall, rpossible_actions, rcheck, rfold, rbet, rraise, rcall, blind_amt, real_player_id, cold_call_pf, steal_hu_chance, steal_hu_fold, chip_count ) VALUES ( 7749, 3, 191367, 8, 'Js', 'Td', 'o', 0.7500, 1.2500, 0.0000, 4.0000, 6.0000, 13.2000, 'Y', 'three of a kind, tens', 4, 'JTo', 11, 10, 0, 1, 0, 1, 41743, 4, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 1, 1, 2, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 2, 0, 1, 0, 0, 1, 1, 0, 1, 0, 0, 0, 1, 0, 0, 1, 0, 0, 0.0000, 7749, 0, 0, 0, 44.5500 )
DataObject: d_game_players
Syntax In Error: INSERT INTO game_players ( player_id, seat_number, game_id, button, hole_card_1, hole_card_2, suited, pre_flop_bet, flop_bet, turn_bet, river_bet, total_bet, total_won, played_hand, final_hand, hand_rank_id, hole_cards, card_order1, card_order2, card_order3, connector_hand, pair_hand, won_hand, session_id, off_the_button, number_of_players, big_blind_n, small_blind_n, pre_flop_raise_n, flop_raise_n, flop_ck_raise_n, turn_bet_raise_n, turn_bet_ck_raise_n, river_bet_raise_n, river_bet_ck_raise_n, went_to_showdown_n, saw_flop_n, saw_flop_blind_n, attempted_steal, chance_to_steal, steal_attempted, folded_to_steal_attempt, raised_first_pf, vol_put_money_in_pot, limp_with_prev_callers, ppossible_actions, pfold, pcheck, praise, pcall, limp_call_reraise_pf, pfr_check, pfr_call, pfr_fold, pfr_bet, pfr_raise, folded_to_river_bet, fpossible_actions, ffold, fcheck, fbet, fraise, fcall, tpossible_actions, tfold, tcheck, tbet, traise, tcall, rpossible_actions, rcheck, rfold, rbet, rraise, rcall, blind_amt, real_player_id, cold_call_pf, steal_hu_chance, steal_hu_fold, chip_count ) VALUES ( 7749, 3, 191367, 8, 'Js', 'Td', 'o', 0.7500, 1.2500, 0.0000, 4.0000, 6.0000, 13.2000, 'Y', 'three of a kind, tens', 4, 'JTo', 11, 10, 0, 1, 0, 1, 41743, 4, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 1, 1, 2, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 2, 0, 1, 0, 0, 1, 1, 0, 1, 0, 0, 0, 1, 0, 0, 1, 0, 0, 0.0000, 7749, 0, 0, 0, 44.5500 )

[ptrack pat]

You can try reindexing as detailed here
http://www.pokertracker3.com/forums/arc ... ex+pgadmin

You can just reindex the GAME_PLAYERS table as that is the one causing the error.

[tercet]

Re_indexed game_players and a few other tables..

New Error

*********************************
PT Version: 2.17.02a
Error Date: 07/19/2008 00:57
Database Error: 7
Error Text: SQLSTATE = XX000
ERROR: could not read block 2688 of relation 1663/24811/24971: Invalid argument;
Error while executing the query

No changes made to database.

INSERT INTO game_players ( player_id, seat_number, game_id, button, pre_flop_bet, flop_bet, turn_bet, river_bet, total_bet, total_won, when_folded, played_hand, won_hand, session_id, off_the_button, number_of_players, big_blind_n, small_blind_n, pre_flop_raise_n, flop_raise_n, flop_ck_raise_n, turn_bet_raise_n, turn_bet_ck_raise_n, river_bet_raise_n, river_bet_ck_raise_n, went_to_showdown_n, saw_flop_n, saw_flop_blind_n, attempted_steal, chance_to_steal, steal_attempted, folded_to_steal_attempt, raised_first_pf, vol_put_money_in_pot, limp_with_prev_callers, ppossible_actions, pfold, pcheck, praise, pcall, limp_call_reraise_pf, pfr_check, pfr_call, pfr_fold, pfr_bet, pfr_raise, folded_to_river_bet, fpossible_actions, ffold, fcheck, fbet, fraise, fcall, tpossible_actions, tfold, tcheck, tbet, traise, tcall, rpossible_actions, rcheck, rfold, rbet, rraise, rcall, blind_amt, real_player_id, cold_call_pf, steal_hu_chance, steal_hu_fold, chip_count ) VALUES ( 2742, 2, 120538, 1, 0.1000, 0.0000, 0.0000, 0.0000, 0.1000, 0.0000, 'Pre-flop', 'Y', 0, 21455, 8, 9, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.1000, 2742, 0, 0, 0, 16.5500 )
DataObject: d_game_players
Syntax In Error: INSERT INTO game_players ( player_id, seat_number, game_id, button, pre_flop_bet, flop_bet, turn_bet, river_bet, total_bet, total_won, when_folded, played_hand, won_hand, session_id, off_the_button, number_of_players, big_blind_n, small_blind_n, pre_flop_raise_n, flop_raise_n, flop_ck_raise_n, turn_bet_raise_n, turn_bet_ck_raise_n, river_bet_raise_n, river_bet_ck_raise_n, went_to_showdown_n, saw_flop_n, saw_flop_blind_n, attempted_steal, chance_to_steal, steal_attempted, folded_to_steal_attempt, raised_first_pf, vol_put_money_in_pot, limp_with_prev_callers, ppossible_actions, pfold, pcheck, praise, pcall, limp_call_reraise_pf, pfr_check, pfr_call, pfr_fold, pfr_bet, pfr_raise, folded_to_river_bet, fpossible_actions, ffold, fcheck, fbet, fraise, fcall, tpossible_actions, tfold, tcheck, tbet, traise, tcall, rpossible_actions, rcheck, rfold, rbet, rraise, rcall, blind_amt, real_player_id, cold_call_pf, steal_hu_chance, steal_hu_fold, chip_count ) VALUES ( 2742, 2, 120538, 1, 0.1000, 0.0000, 0.0000, 0.0000, 0.1000, 0.0000, 'Pre-flop', 'Y', 0, 21455, 8, 9, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.1000, 2742, 0, 0, 0, 16.5500 )
*********************************

[ptrack pat]

It's the same type of error on the same table. Reindex it again. Does it give you an error when you do this?