CVS log for pgloader/pgloader/examples/parallel.conf

Default branch: MAIN

Revision 1.9 / (download) - annotate - [select for diffs], Sat Feb 16 19:17:03 2008 UTC (4 years, 2 months ago) by dim
Branch: MAIN
CVS Tags: HEAD
Changes since 1.8: +2 -2 lines
Diff to previous 1.8 (unified)

FIX round-robin reader case when not all configured threads are needed to load the file

Revision 1.8 / (download) - annotate - [select for diffs], Thu Feb 14 22:25:24 2008 UTC (4 years, 3 months ago) by dim
Branch: MAIN
Changes since 1.7: +15 -2 lines
Diff to previous 1.7 (unified)

Generalize unbuffered file reading to a file-like class and use it in csvreader and textreader. Almost ok now, or so it seems

Revision 1.7 / (download) - annotate - [select for diffs], Thu Feb 14 17:17:55 2008 UTC (4 years, 3 months ago) by dim
Branch: MAIN
Changes since 1.6: +1 -1 lines
Diff to previous 1.6 (unified)

Split file reading works with text format (problem was file iterator buffering)

Revision 1.6 / (download) - annotate - [select for diffs], Thu Feb 14 14:57:47 2008 UTC (4 years, 3 months ago) by dim
Branch: MAIN
Changes since 1.5: +3 -3 lines
Diff to previous 1.5 (unified)

FIX just-introduced bug: no reader init meant self.db.copy_sep = None

Revision 1.5 / (download) - annotate - [select for diffs], Thu Feb 14 12:18:49 2008 UTC (4 years, 3 months ago) by dim
Branch: MAIN
Changes since 1.4: +1 -1 lines
Diff to previous 1.4 (unified)

Factorize readers file opening code

Revision 1.4 / (download) - annotate - [select for diffs], Wed Feb 13 17:12:30 2008 UTC (4 years, 3 months ago) by dim
Branch: MAIN
Changes since 1.3: +10 -9 lines
Diff to previous 1.3 (unified)

DEBUG attempts of split_read_file(), renaming of internal methods, tests using text instead of csv

Revision 1.3 / (download) - annotate - [select for diffs], Wed Feb 13 09:42:25 2008 UTC (4 years, 3 months ago) by dim
Branch: MAIN
Changes since 1.2: +1 -0 lines
Diff to previous 1.2 (unified)

Support for 'rrqueue_size' per-section configuration parameter, defaults to copy_every

Revision 1.2 / (download) - annotate - [select for diffs], Tue Feb 12 12:24:14 2008 UTC (4 years, 3 months ago) by dim
Branch: MAIN
Changes since 1.1: +4 -3 lines
Diff to previous 1.1 (unified)

Better handling of split_file_reading case, Still In Progress

Revision 1.1 / (download) - annotate - [select for diffs], Tue Feb 12 11:27:06 2008 UTC (4 years, 3 months ago) by dim
Branch: MAIN

Using semaphores to control how many max threads run at any given time