]> git.deb.at Git - deb/packages.git/log
deb/packages.git
18 years agoDocument contents backend stuff loosely, still subject to change
Jeroen van Wolffelaar [Tue, 14 Feb 2006 02:07:32 +0000 (02:07 +0000)]
Document contents backend stuff loosely, still subject to change
(filenames_$suite.txt is inadequate)

18 years agoAdd my comments
Jeroen van Wolffelaar [Tue, 14 Feb 2006 02:02:40 +0000 (02:02 +0000)]
Add my comments

18 years agoImplement exact filename searches properly, implement random-substring
Jeroen van Wolffelaar [Tue, 14 Feb 2006 01:37:27 +0000 (01:37 +0000)]
Implement exact filename searches properly, implement random-substring
filename searches (but takes 4s worstcase on merkel...)

18 years agoMake it more obvious what are static strings and what are parameters
Frank Lichtenheld [Tue, 14 Feb 2006 01:28:00 +0000 (01:28 +0000)]
Make it more obvious what are static strings and what are parameters

18 years agoTry to give an overview over the different uses of packages.d.o
Frank Lichtenheld [Tue, 14 Feb 2006 01:12:44 +0000 (01:12 +0000)]
Try to give an overview over the different uses of packages.d.o
and the parameters that need to be given for each one

18 years agoImplement exact filename searching
Jeroen van Wolffelaar [Tue, 14 Feb 2006 00:33:15 +0000 (00:33 +0000)]
Implement exact filename searching

18 years agoImplement search_contents bluntly
Jeroen van Wolffelaar [Tue, 14 Feb 2006 00:27:02 +0000 (00:27 +0000)]
Implement search_contents bluntly

18 years agoAdd working download.pl
Frank Lichtenheld [Mon, 13 Feb 2006 23:44:35 +0000 (23:44 +0000)]
Add working download.pl

18 years agoClarify where virtual stuff goes wrong
Jeroen van Wolffelaar [Mon, 13 Feb 2006 23:42:24 +0000 (23:42 +0000)]
Clarify where virtual stuff goes wrong

18 years agoFix path to contents db
Jeroen van Wolffelaar [Mon, 13 Feb 2006 23:18:31 +0000 (23:18 +0000)]
Fix path to contents db

18 years ago- Significant performance and memory demand improvements
Jeroen van Wolffelaar [Mon, 13 Feb 2006 23:15:24 +0000 (23:15 +0000)]
- Significant performance and memory demand improvements
- cache filename list appropriately
- create reverse db per suite, not per (suite,arch)
- stash DB's in subdir of $DBDIR, to not clutter the toplevel dbdir up too
  much

18 years agoAdd documentation about used backend files
Jeroen van Wolffelaar [Mon, 13 Feb 2006 20:49:57 +0000 (20:49 +0000)]
Add documentation about used backend files

18 years agoDisable multi-page results while that is inefficient and we don't show more
Jeroen van Wolffelaar [Fri, 10 Feb 2006 22:18:31 +0000 (22:18 +0000)]
Disable multi-page results while that is inefficient and we don't show more
than 100 results ever anyway

18 years agoFix a link w.r.t. $ROOT
Jeroen van Wolffelaar [Fri, 10 Feb 2006 22:17:27 +0000 (22:17 +0000)]
Fix a link w.r.t. $ROOT

18 years agoFix full description search: operator precedence causing zero hits, match
Jeroen van Wolffelaar [Fri, 10 Feb 2006 22:17:05 +0000 (22:17 +0000)]
Fix full description search: operator precedence causing zero hits, match
arch=all always instead of never, and stop after 100 results and set
too_many_results accordingly

18 years agoFix typo, add entry for contents search
Jeroen van Wolffelaar [Fri, 10 Feb 2006 21:52:05 +0000 (21:52 +0000)]
Fix typo, add entry for contents search

18 years agoAdd note about wrong assumption that a package is either virtual or concrete
Jeroen van Wolffelaar [Fri, 10 Feb 2006 21:49:47 +0000 (21:49 +0000)]
Add note about wrong assumption that a package is either virtual or concrete

18 years agoOptimize and improve full description search by stripping away insignificant
Jeroen van Wolffelaar [Fri, 10 Feb 2006 12:49:58 +0000 (12:49 +0000)]
Optimize and improve full description search by stripping away insignificant
characters, and use 'index' instead of 'regex'. Dropped possibility to do
caseful searches.

18 years agoPrint out headers
Frank Lichtenheld [Fri, 10 Feb 2006 05:05:50 +0000 (05:05 +0000)]
Print out headers

18 years ago* complete virtual package support
Frank Lichtenheld [Fri, 10 Feb 2006 02:13:18 +0000 (02:13 +0000)]
* complete virtual package support
* hardcode encoding of script output to be declared as utf-8 for now, better
  than the CGI.pm default of ISO-8859-1

18 years agoBegin implementing virtual package support.
Frank Lichtenheld [Thu, 9 Feb 2006 17:48:17 +0000 (17:48 +0000)]
Begin implementing virtual package support.
search_package is already working, show_package needs more work

18 years agoFix regex for contents lines: stray tabs got included
Jeroen van Wolffelaar [Wed, 8 Feb 2006 20:26:18 +0000 (20:26 +0000)]
Fix regex for contents lines: stray tabs got included

18 years agoShow filelist from suite/arch specific db
Jeroen van Wolffelaar [Wed, 8 Feb 2006 20:17:43 +0000 (20:17 +0000)]
Show filelist from suite/arch specific db

18 years agoGenerate contents indices for all suites and archs
Jeroen van Wolffelaar [Wed, 8 Feb 2006 20:06:00 +0000 (20:06 +0000)]
Generate contents indices for all suites and archs

18 years agoBasic show_filelist -- works, but ignores arch & suite, takes always the same
Jeroen van Wolffelaar [Wed, 8 Feb 2006 14:31:21 +0000 (14:31 +0000)]
Basic show_filelist -- works, but ignores arch & suite, takes always the same
db

18 years agoWrite out filelists to packages_contents.db in locate-like packed format
Jeroen van Wolffelaar [Wed, 8 Feb 2006 13:32:35 +0000 (13:32 +0000)]
Write out filelists to packages_contents.db in locate-like packed format

18 years agoFirst version of parse-contents, for proto-implementing postfix searches
Jeroen van Wolffelaar [Tue, 7 Feb 2006 16:21:51 +0000 (16:21 +0000)]
First version of parse-contents, for proto-implementing postfix searches

18 years agoAdapt to DB format changes
Frank Lichtenheld [Tue, 7 Feb 2006 15:53:55 +0000 (15:53 +0000)]
Adapt to DB format changes

18 years agoNote about archive/suite, note bug in amd64/security
Jeroen van Wolffelaar [Tue, 7 Feb 2006 15:43:41 +0000 (15:43 +0000)]
Note about archive/suite, note bug in amd64/security

18 years agoMake a note about order in _small.db
Jeroen van Wolffelaar [Tue, 7 Feb 2006 15:40:55 +0000 (15:40 +0000)]
Make a note about order in _small.db

18 years ago- Add $ROOT at appropriate places
Jeroen van Wolffelaar [Tue, 7 Feb 2006 15:20:54 +0000 (15:20 +0000)]
- Add $ROOT at appropriate places
- Move display of 'kB' to the column itself, and right align it

18 years agoOops - drop debugging print
Jeroen van Wolffelaar [Tue, 7 Feb 2006 14:46:34 +0000 (14:46 +0000)]
Oops - drop debugging print

18 years agoReduce complexity during show_package by storing info in _all.db files
Jeroen van Wolffelaar [Tue, 7 Feb 2006 14:41:04 +0000 (14:41 +0000)]
Reduce complexity during show_package by storing info in _all.db files
NUL-separated.
Also, lookup source packages by archive/suite, instead of version

18 years agoSome adjustments:
Frank Lichtenheld [Tue, 7 Feb 2006 13:29:53 +0000 (13:29 +0000)]
Some adjustments:
 - filelist is arch specific
 - there will be "static" source package pages
 - we shouldn't change the sections index urls just for fun

18 years agoAdd a first attampt at some URL layout document. Comments more than welcome
Jeroen van Wolffelaar [Tue, 7 Feb 2006 13:17:30 +0000 (13:17 +0000)]
Add a first attampt at some URL layout document. Comments more than welcome

18 years ago* Add source package display
Frank Lichtenheld [Tue, 7 Feb 2006 01:01:00 +0000 (01:01 +0000)]
* Add source package display
* Move most of the DB init code to own module

18 years agoCreate index pages
Frank Lichtenheld [Mon, 6 Feb 2006 01:42:28 +0000 (01:42 +0000)]
Create index pages
Some source version handling fixes
Introduce list of section/subsection/priority by suite/archive. Since
these are only used for the static pages currently, they are stored
rather expensive via Storable.
Add priority sorting to Deb::Versions

18 years agoFinally get a working solution that handles both static and dynamic
Frank Lichtenheld [Mon, 6 Feb 2006 01:40:32 +0000 (01:40 +0000)]
Finally get a working solution that handles both static and dynamic
pages correctly

18 years agoFix non-US handling
Frank Lichtenheld [Mon, 6 Feb 2006 01:39:49 +0000 (01:39 +0000)]
Fix non-US handling
Fix handling of packages without source package

18 years agoUse local files instead of www.debian.org ones.
Frank Lichtenheld [Mon, 6 Feb 2006 01:38:02 +0000 (01:38 +0000)]
Use local files instead of www.debian.org ones.
Fix handling of packages with missing source package.

18 years agoImport from old source
Frank Lichtenheld [Mon, 6 Feb 2006 01:34:26 +0000 (01:34 +0000)]
Import from old source

18 years agoFix several minor issues, mostly configuration-like stuff
Jeroen van Wolffelaar [Mon, 6 Feb 2006 00:16:40 +0000 (00:16 +0000)]
Fix several minor issues, mostly configuration-like stuff

18 years ago* Move coniguratio stuf to own module
Frank Lichtenheld [Sun, 5 Feb 2006 16:59:48 +0000 (16:59 +0000)]
* Move coniguratio stuf to own module
* Overhaul archive handling for show_package
* Begin to make the URL handling somewhat consistent
* Fix source files handling, which was broken by the last upload

18 years ago* Complete pmoreinfo
Frank Lichtenheld [Sun, 5 Feb 2006 03:14:33 +0000 (03:14 +0000)]
* Complete pmoreinfo
* Some big speed optimisations

18 years agoshow_package.pl Basic stuff works with still some rough edges and dirty
Frank Lichtenheld [Sun, 5 Feb 2006 01:55:18 +0000 (01:55 +0000)]
show_package.pl Basic stuff works with still some rough edges and dirty
corners

18 years agoA minimal working version of show_package.pl (essentially porting yesterday's
Frank Lichtenheld [Sat, 4 Feb 2006 21:00:17 +0000 (21:00 +0000)]
A minimal working version of show_package.pl (essentially porting yesterday's
search_packages changes over)

18 years agoUsed wrong variable for displaying the final benchmark result.
Frank Lichtenheld [Sat, 4 Feb 2006 20:59:08 +0000 (20:59 +0000)]
Used wrong variable for displaying the final benchmark result.
Which actually explains a lot ;)

18 years agoUups
Frank Lichtenheld [Sat, 4 Feb 2006 00:27:17 +0000 (00:27 +0000)]
Uups

18 years ago* Add back some parts of the cron job (100syncarchive_*)
Frank Lichtenheld [Sat, 4 Feb 2006 00:14:50 +0000 (00:14 +0000)]
* Add back some parts of the cron job (100syncarchive_*)
* Use these files from bin/parse-*
* Support different archives

18 years agoForgot to commit some new files related to the mod_perl changes
Frank Lichtenheld [Sat, 4 Feb 2006 00:12:06 +0000 (00:12 +0000)]
Forgot to commit some new files related to the mod_perl changes

18 years agoUpdate
Frank Lichtenheld [Fri, 3 Feb 2006 20:05:40 +0000 (20:05 +0000)]
Update

18 years agoThese changes make the search_packages.pl script mod_perl ready
Frank Lichtenheld [Fri, 3 Feb 2006 20:03:19 +0000 (20:03 +0000)]
These changes make the search_packages.pl script mod_perl ready
and try to make some optimisations for this (e.g. tie'ing the
Databases only once)

18 years agoAlso move the result printing to a function
Frank Lichtenheld [Thu, 2 Feb 2006 16:00:16 +0000 (16:00 +0000)]
Also move the result printing to a function

18 years agoDo some work to get show_package.pl to work -- not completed yet
Jeroen van Wolffelaar [Thu, 2 Feb 2006 15:52:46 +0000 (15:52 +0000)]
Do some work to get show_package.pl to work -- not completed yet

18 years agoAdd $Id$
Jeroen van Wolffelaar [Thu, 2 Feb 2006 15:39:22 +0000 (15:39 +0000)]
Add $Id$

18 years ago* Move all the debug/error/message output to functions so that
Frank Lichtenheld [Thu, 2 Feb 2006 15:32:21 +0000 (15:32 +0000)]
* Move all the debug/error/message output to functions so that
  we can bundle all output at one point
* Read root variable (for $ROOT) from config.sh if available

18 years agoBluntly copy package_pages_walker
Jeroen van Wolffelaar [Thu, 2 Feb 2006 15:29:20 +0000 (15:29 +0000)]
Bluntly copy package_pages_walker

18 years agoPrint links to alternative suites, print raw data from _all db
Jeroen van Wolffelaar [Thu, 2 Feb 2006 15:07:43 +0000 (15:07 +0000)]
Print links to alternative suites, print raw data from _all db

18 years agoCompletly remove the XML stuff. I never really used it and currently it
Frank Lichtenheld [Thu, 2 Feb 2006 14:44:26 +0000 (14:44 +0000)]
Completly remove the XML stuff. I never really used it and currently it
just clobbers the code

18 years ago* Fix display of binary packages in source package search
Frank Lichtenheld [Thu, 2 Feb 2006 14:40:24 +0000 (14:40 +0000)]
* Fix display of binary packages in source package search
* Completly get rid of global variables in read_* and do_names_search

18 years agoPrint footer
Jeroen van Wolffelaar [Thu, 2 Feb 2006 13:58:08 +0000 (13:58 +0000)]
Print footer

18 years agoMove some more parameter logic to the Search.pm modul
Frank Lichtenheld [Thu, 2 Feb 2006 13:57:34 +0000 (13:57 +0000)]
Move some more parameter logic to the Search.pm modul

18 years agoFirst version of the 'static page' dynamic perl script
Jeroen van Wolffelaar [Thu, 2 Feb 2006 13:49:08 +0000 (13:49 +0000)]
First version of the 'static page' dynamic perl script

18 years agoSet $ROOT. Sorry Frank, but I don't know much about globals and config.sh...
Jeroen van Wolffelaar [Thu, 2 Feb 2006 13:25:28 +0000 (13:25 +0000)]
Set $ROOT. Sorry Frank, but I don't know much about globals and config.sh...
maybe you can look into that :)?

18 years agoAllow "static page" url's
Jeroen van Wolffelaar [Thu, 2 Feb 2006 13:23:32 +0000 (13:23 +0000)]
Allow "static page" url's

18 years ago- Move fulltext search to own function, too
Frank Lichtenheld [Thu, 2 Feb 2006 13:17:31 +0000 (13:17 +0000)]
- Move fulltext search to own function, too
- Use fewer global variables in the search functions, should be
  reduced to none, really
- Fix some Perl warnings

18 years agoPrint total page evaluation time if debug allowed (also nice hint that you
Jeroen van Wolffelaar [Thu, 2 Feb 2006 12:47:44 +0000 (12:47 +0000)]
Print total page evaluation time if debug allowed (also nice hint that you
left that on in production)

18 years agoFix thinko, now returning all substring results again
Jeroen van Wolffelaar [Thu, 2 Feb 2006 12:34:25 +0000 (12:34 +0000)]
Fix thinko, now returning all substring results again
s/too much hits/too many hits/

18 years agoDeal correctly with exact matches on substring search, and don't yield bogus
Jeroen van Wolffelaar [Thu, 2 Feb 2006 12:23:50 +0000 (12:23 +0000)]
Deal correctly with exact matches on substring search, and don't yield bogus
only result when there was no match

18 years agoSome random idea's and thoughts
Jeroen van Wolffelaar [Thu, 2 Feb 2006 12:11:38 +0000 (12:11 +0000)]
Some random idea's and thoughts

18 years agoCopy of default search form page
Jeroen van Wolffelaar [Thu, 2 Feb 2006 11:29:41 +0000 (11:29 +0000)]
Copy of default search form page

18 years agoUse $SEARCH_CGI
Jeroen van Wolffelaar [Thu, 2 Feb 2006 11:27:42 +0000 (11:27 +0000)]
Use $SEARCH_CGI

18 years agoIntroduce php wrapper for those hosts that don't have perl enabled
Jeroen van Wolffelaar [Thu, 2 Feb 2006 11:26:47 +0000 (11:26 +0000)]
Introduce php wrapper for those hosts that don't have perl enabled

18 years agoIntroduce $SEARCH_CGI
Jeroen van Wolffelaar [Thu, 2 Feb 2006 11:25:40 +0000 (11:25 +0000)]
Introduce $SEARCH_CGI

18 years agoRead options from stdin when called from PHP, nuke tons of warnings by setting
Jeroen van Wolffelaar [Thu, 2 Feb 2006 11:00:52 +0000 (11:00 +0000)]
Read options from stdin when called from PHP, nuke tons of warnings by setting
$debug if not defined

18 years agoSome general checklist notes
Jeroen van Wolffelaar [Thu, 2 Feb 2006 01:36:01 +0000 (01:36 +0000)]
Some general checklist notes

18 years agoFirst version of TODO listing items to think about
Jeroen van Wolffelaar [Thu, 2 Feb 2006 01:35:20 +0000 (01:35 +0000)]
First version of TODO listing items to think about

18 years agoIn postfixes db's, store empty prefix as '^' to work around weird split
Jeroen van Wolffelaar [Thu, 2 Feb 2006 01:02:23 +0000 (01:02 +0000)]
In postfixes db's, store empty prefix as '^' to work around weird split
behaviour

18 years agoImplement postfix search for source packages and merge the
Frank Lichtenheld [Thu, 2 Feb 2006 00:51:35 +0000 (00:51 +0000)]
Implement postfix search for source packages and merge the
code for names and sourcenames search together

18 years agoAdd full text search
Frank Lichtenheld [Thu, 2 Feb 2006 00:39:13 +0000 (00:39 +0000)]
Add full text search

18 years agoDrop NUL characters and collate whitespace in descriptions.txt
Jeroen van Wolffelaar [Thu, 2 Feb 2006 00:16:06 +0000 (00:16 +0000)]
Drop NUL characters and collate whitespace in descriptions.txt

18 years agoIn packages_all_$suite, store only description Id, not full description, nor
Jeroen van Wolffelaar [Thu, 2 Feb 2006 00:08:37 +0000 (00:08 +0000)]
In packages_all_$suite, store only description Id, not full description, nor
repeat those fields that are already in the index. *do* add fields that are
not normally available, such as the section & subsection one, and always a
'source' one without version, that always exists and points to the source.

Drop maintainer too, that info should be gotten from source package, which has
co-maintainers too

18 years agoImplement source postfixes
Jeroen van Wolffelaar [Wed, 1 Feb 2006 23:51:41 +0000 (23:51 +0000)]
Implement source postfixes

18 years agoImplement prefix search for package name subword matches. Should be way
Frank Lichtenheld [Wed, 1 Feb 2006 23:32:30 +0000 (23:32 +0000)]
Implement prefix search for package name subword matches. Should be way
faster now

18 years agoImplement source package names search (no binary package information
Frank Lichtenheld [Wed, 1 Feb 2006 21:55:20 +0000 (21:55 +0000)]
Implement source package names search (no binary package information
yet)

18 years agoDrop srcversion logic that was unused
Jeroen van Wolffelaar [Wed, 1 Feb 2006 21:46:00 +0000 (21:46 +0000)]
Drop srcversion logic that was unused

18 years agoSet priority to '-' if it isn't in the Sources.gz file
Jeroen van Wolffelaar [Wed, 1 Feb 2006 21:45:33 +0000 (21:45 +0000)]
Set priority to '-' if it isn't in the Sources.gz file

18 years ago- Add working debugging mode (1 as parameter -> do only non-free)
Jeroen van Wolffelaar [Wed, 1 Feb 2006 21:29:41 +0000 (21:29 +0000)]
- Add working debugging mode (1 as parameter -> do only non-free)
- Add sources_small.db
- Split section also in sources_all

18 years agoSplit section (main, etc.) from subsection (admin, etc.) on db generation
Frank Lichtenheld [Wed, 1 Feb 2006 21:15:14 +0000 (21:15 +0000)]
Split section (main, etc.) from subsection (admin, etc.) on db generation

18 years agoImplement package postfix indexing
Jeroen van Wolffelaar [Wed, 1 Feb 2006 20:39:59 +0000 (20:39 +0000)]
Implement package postfix indexing

18 years agoImplement subword package search by linear search. Too slow, though
Frank Lichtenheld [Wed, 1 Feb 2006 20:00:45 +0000 (20:00 +0000)]
Implement subword package search by linear search. Too slow, though

18 years ago* Implement exact packages search
Frank Lichtenheld [Wed, 1 Feb 2006 19:13:44 +0000 (19:13 +0000)]
* Implement exact packages search
* Implement path parsing

18 years agoAdd some dummy sub routines that emulate some yet missing modules
Frank Lichtenheld [Wed, 1 Feb 2006 19:08:15 +0000 (19:08 +0000)]
Add some dummy sub routines that emulate some yet missing modules

18 years ago* Adapt for current hosting (i.e. packages.debian.net)
Frank Lichtenheld [Wed, 1 Feb 2006 19:07:22 +0000 (19:07 +0000)]
* Adapt for current hosting (i.e. packages.debian.net)
* Add possibility to pass path-info to the search script via
  PT

18 years agoRemove debugging shortcut
Jeroen van Wolffelaar [Wed, 1 Feb 2006 15:28:50 +0000 (15:28 +0000)]
Remove debugging shortcut

18 years agoParse scripts for Packages.gz files and Sources.gz files, to generate database
Jeroen van Wolffelaar [Wed, 1 Feb 2006 15:18:06 +0000 (15:18 +0000)]
Parse scripts for Packages.gz files and Sources.gz files, to generate database
files

18 years agoInclude all stuff to be quickly able to set up a experimental search script
Frank Lichtenheld [Wed, 1 Feb 2006 15:09:57 +0000 (15:09 +0000)]
Include all stuff to be quickly able to set up a experimental search script

18 years agoAdd apache configuration
Frank Lichtenheld [Wed, 1 Feb 2006 14:44:35 +0000 (14:44 +0000)]
Add apache configuration

18 years agoPaging stuff that is independent from any backend considerations
Frank Lichtenheld [Wed, 1 Feb 2006 14:29:55 +0000 (14:29 +0000)]
Paging stuff that is independent from any backend considerations

18 years agoInclude some stuff from the old pages we will need anyway
Frank Lichtenheld [Wed, 1 Feb 2006 14:26:41 +0000 (14:26 +0000)]
Include some stuff from the old pages we will need anyway