CVS log for interchange/lib/Vend/TextSearch.pm

Up to [Local Repository] / interchange / lib / Vend

Request diff between arbitrary revisions

Keyword substitution: kv
Default branch: MAIN

remove trailing whitespace from text file headers

* Updated copyright headers to 2007 (closes bug #102)

* Added GPL and copyright headers to a few files that were missing them.

New Free Software Foundation Address in headers of various files

New Free Software Foundation Address in headers of various files

Big copyright and version number update to prepare for 5.3.2 release.

Remove some duplicate glob assignments for subroutines in other modules.
To do this easily, I did "expand -t4" and "LC_ALL=C sort -u".

* We had been running without warnings so long, we had gotten a bit sloppy
  in our code in some places.

  Because we do lots of uninitialized hash member stuff with arrays
  of fields and $opt, it is basically unreasonable for us to run with
  the "use of uninitialized variable" warnings. Because we do a fair
  amount of numerical comparisons on empty string values, it seemed
  unreasonable to run with "string value in numeric gt" enabled.

  Also, because Safe, HTML::Entities, and some other modules have
  these checks enabled, page code is bound to have warnings issued
  no matter what you do.

  It seems better to run with some warnings enabled so that we can
  catch bad code practice.

  So I have made the code run without warnings prior to and after
  interpolate_html(), and turned off warnings by default in the
  page code.

  If it is desirable to turn on warnings for pages, you can use
  [pragma perl_warnings_in_page] and see warnings for that page
  (or by default if you put in catalog.cfg).

* In general these changes are:

	 no warnings qw(uninitialized numeric);

  in most pages.

* Add $::Pragma->{perl_warnings_in_page}.

* Remove defined checks when simple set tests will do.

* Streamline some code.

The great copyright, email address, URL, and version update.

updated LINUXIA branch to 4.9 sources in order to use it as testbed again

Sweeping update of Akopia/Red Hat references, to prepare for 4.8 release
with current Interchange URLs and contact information.

* Remove min_string test from Search.pm, where it never really was used
  or called due to mv_min_string default being 0.

* Place mv_min_string check back in Glimpse where it was intended in the first
  place.

* Resolves Bugzilla #255 reported by dst@vernet.gr (Dimitris Tsamitros).

* Remove min_string test from Search.pm, where it never really was used
  or called due to mv_min_string default being 0.

* Place mv_min_string check back in Glimpse where it was intended in the first
  place.

* Resolves Bugzilla #255.

* Get rid of mv_range_look check now that it will be deprecated and removed
  from docs.

Add option to disable matchlimit entirely, with ml=all or ml=none.
Allow default of 50 to be changed in catalog variable MV_DEFAULT_MATCHLIMIT.

Oops! Should not have removed that first $s->{matches} assignment, could
have led to some breakage.

Implementing mv_max_matches as done in stable branch earlier today.

Implementing mv_max_matches: if > 0, the search results will spliced at
its offset.

Big copyright date update. This will be the last time that Red Hat
copyright notices get updated en masse, since the bulk of new code will
very likely come from non-Red Hat employees.

    * Add new mv_next_search, which allows filtering searches
      through another search after the first one returns
      some rows.

    * Add search_reference() method to Search.pm

    * Add st=ref to allow searching of an array of arrays with
      an IC search -- I would not think it too useful but this
      type of thing has been requested

    * New Vend::RefSearch actually does the search

    * Search is passed by setting in a scratch variable right now,
      suggestions on how to better pass it are appreciated

    * A small test will be posted to core list.

	* Fix nasty search bug in TextSearch, caused trashing of searches
	  by overwriting $_.

	* Remove redundant code in both Search.pm and TextSearch.pm

	* Remove passed argument for escape_scan, was already the default.

Update version number and copyright year, to prepare for the eventual
day when we release version 4.8.4.

* Add new MIRROR parameter for databases. This allows creation of a
  DBM or Memory mirror.

  Sequence is:

	1. Table is always imported at config time.
	2. Table is only imported once.
	3. Text file is not required, but should be set so export
	   can work properly and so there is a placeholder.

  A complete configuration is:

	  Database  products_mem  products_mem.txt  TAB
	  Database  products_mem  MIRROR  products
	  Database  products_mem  MEMORY  1

  MIRROR name is not set in stone yet, probably not apropos
  enough; suggestions are welcome.

  Benchmarks for 1000 separate (i.e. tag_data, no caching)
  accesses (repeated tries show these are representative):

	Doing products_mem:
	Class=MEMORY DSN=
	Data returned 247 bytes
	TIME=0.200

	Doing products:
	Class=DBI DSN=dbi:mysql:test_mfound
	Data returned 247 bytes
	TIME=0.670

	Doing alias_mem:
	Class=MEMORY DSN=
	Data returned 9 bytes
	TIME=0.180

	Doing alias:
	Class=DBI DSN=dbi:Pg:dbname=wikicms
	Data returned 9 bytes
	TIME=0.700

	Doing wiki_mem:
	Class=GDBM DSN=
	Data returned 400 bytes
	TIME=0.300

	Doing wiki_mem2:
	Class=MEMORY DSN=
	Data returned 400 bytes
	TIME=0.180

	Doing wiki:
	Class=DBI DSN=dbi:Pg:dbname=wikicms
	Data returned 400 bytes
	TIME=0.710

 Gains should be even bigger as no database connections are needed
 on a busy system.

I finally found it! The bug was only for text searches, so it went away
when I changed icmenu's search type to db.

The array of search lines was getting crammed into a single array element
on the second pass for sorting.

	* Make the DbSearch module search references and not tab-joined lines.

	* Search.pm now modifies its behavior for $limit_sub->() and $return_sub->()
	  to create a reference if needed.

	* This solves the tab-delimited wrong-search-result problem while
	  increasing performance up to 20% on large database records.

	* Slight change to each_nokey() routine -- it returns a
	  reference instead of a list. This should have no side-effect
	  unless someone happened to use the
	  Vend::Table::*::each_nokey() routine somewhere in custom code.
	  Certainly this is not documented as part of the API, and we
	  never use it in any of our stuff.

	* Change passes regression tests 100%. Glimpse is not really
	  tested though I anticipate no problems.

Upping major version number after trunk/branch switch.

Move DEV_4_7_0 development branch to repository trunk.

Update copyright notices and email addresses.
Standardize module headers and remove a few shebang lines.

Whitespace changes (diff -b -B will report nothing)

stylistic changes

Fixed bug in hashref routine for query. This fixes a reported problem
WRT order reports not working for DBM databases.

Server:
	necessary change to support minivend->interchange script rename

DbSearch/Glimpse/TextSearch:
	comment change s/MINIVEND/INTERCHANGE on line 5

Util:
	changed -t option in syslogging routine from minivend to interchange

Made sure we had some search_files even when MV_DEFAULT_SEARCH_FILE gets hosed.

Added multiple security fixes.
Added beginnings of IPC to perl programs.
Added Sub (catalog.cfg) link to [PREFIX-exec].
Added hs (head skip) option to [import ....] tag.

Changed Interchange name all over, minor exceptions being mvfaq.pod and
mvrpm.pod. Changed copyright notice to Akopia.

Added mv_start_match to find first key matching specification.
Like mv_first_match, except sets based on value of match and
not index of match.

Added more security to Session.pm, saving username safe from
manipulation by user.

Initial import of changed Challenger with UI instead of Minimate.

Initial revision