pazpar2-moved-to-github.git
14 years agoRefactor PP2 charsets handling, use pazpar2_mutex.
Adam Dickmeiss [Mon, 15 Mar 2010 14:21:30 +0000 (15:21 +0100)]
Refactor PP2 charsets handling, use pazpar2_mutex.

pp2_relvance_tokenize split into functions pp2_relvance_tokenize
and pp2_relevance_first. This allows ICU tokenize handlers to be
reused within a thread and makes ingest_to_cluster slightly faster.

14 years agoRemove redundant decl
Adam Dickmeiss [Mon, 15 Mar 2010 14:19:10 +0000 (15:19 +0100)]
Remove redundant decl

14 years agoRequires YAZ 4.0.2
Adam Dickmeiss [Mon, 15 Mar 2010 14:18:42 +0000 (15:18 +0100)]
Requires YAZ 4.0.2

14 years agoAdd yaz_mutex_create wrapper - for debugging
Adam Dickmeiss [Mon, 15 Mar 2010 14:17:07 +0000 (15:17 +0100)]
Add yaz_mutex_create wrapper - for debugging

14 years agoRequire YAZ 4.0.2 (due to ICU iter)
Adam Dickmeiss [Mon, 15 Mar 2010 14:15:43 +0000 (15:15 +0100)]
Require YAZ 4.0.2 (due to ICU iter)

14 years agoAdd name parameter to iochan_create
Adam Dickmeiss [Mon, 15 Mar 2010 14:09:15 +0000 (15:09 +0100)]
Add name parameter to iochan_create

14 years agoLogging channels and mutexes + a few other things
Adam Dickmeiss [Fri, 12 Mar 2010 16:23:35 +0000 (17:23 +0100)]
Logging channels and mutexes + a few other things

14 years agoAdd WAIT between multi-sessions
Adam Dickmeiss [Fri, 12 Mar 2010 16:22:24 +0000 (17:22 +0100)]
Add WAIT between multi-sessions

14 years agoFix connection_is_idle test for idleness
Adam Dickmeiss [Fri, 12 Mar 2010 15:24:01 +0000 (16:24 +0100)]
Fix connection_is_idle test for idleness

Function connection_is_idle no longer returns 1 (idle) if
ZOOM_connection_peek_event returns ZOOM_EVENT_END. The problem is that
when this is returned another thread may still be chewing on a record.

14 years agoMore tuning for bash-based perf test
Adam Dickmeiss [Fri, 12 Mar 2010 15:20:12 +0000 (16:20 +0100)]
More tuning for bash-based perf test

14 years agoFix SEGV: client.database reference
Adam Dickmeiss [Thu, 11 Mar 2010 14:44:17 +0000 (15:44 +0100)]
Fix SEGV: client.database reference

Ensure client.database (session_database) is set to NULL when it
is no longer associated with a session. If it is NULL, then function
client_get_URL will return "NOURL".

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Thu, 11 Mar 2010 13:58:24 +0000 (14:58 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoMore complete pazpar2 conf cleanup
Adam Dickmeiss [Thu, 11 Mar 2010 13:57:33 +0000 (14:57 +0100)]
More complete pazpar2 conf cleanup

14 years agoiochan_man_destroy destroys channels
Adam Dickmeiss [Thu, 11 Mar 2010 13:56:34 +0000 (14:56 +0100)]
iochan_man_destroy destroys channels

14 years agoFix uninit var for session act
Adam Dickmeiss [Thu, 11 Mar 2010 13:55:23 +0000 (14:55 +0100)]
Fix uninit var for session act

14 years agoAdd database_hosts_destroy
Adam Dickmeiss [Thu, 11 Mar 2010 13:54:53 +0000 (14:54 +0100)]
Add database_hosts_destroy

14 years agoUse proper extensions
Jakub Skoczen [Thu, 11 Mar 2010 12:36:28 +0000 (13:36 +0100)]
Use proper extensions

14 years agoRemvoe jmeter.log
Jakub Skoczen [Thu, 11 Mar 2010 12:32:13 +0000 (13:32 +0100)]
Remvoe jmeter.log

And introduce changes reported in the previous commit.

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Jakub Skoczen [Thu, 11 Mar 2010 12:27:18 +0000 (13:27 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoHit pazpar2 directly (no apache)
Jakub Skoczen [Thu, 11 Mar 2010 12:26:09 +0000 (13:26 +0100)]
Hit pazpar2 directly (no apache)

Also use 40 threads (loop 10 times) and retrieve 50 recs

14 years agoAdd results for jmeter run.
Jakub Skoczen [Thu, 11 Mar 2010 12:25:44 +0000 (13:25 +0100)]
Add results for jmeter run.

14 years agoYLOG_DEBUG for stmt in client_incref
Adam Dickmeiss [Thu, 11 Mar 2010 12:01:51 +0000 (13:01 +0100)]
YLOG_DEBUG for stmt in client_incref

14 years agoRelease record block on show after first chunk
Adam Dickmeiss [Thu, 11 Mar 2010 11:41:59 +0000 (12:41 +0100)]
Release record block on show after first chunk

The client and connection code now fires SESSION_WATCH_SHOW and
SESSION_WATCH_RECORD after all non-blocking events has been received
from some client. Previously this was done on first record received.
Fixes #3318.

14 years agoAdd assert for non-NULL session
Adam Dickmeiss [Thu, 11 Mar 2010 11:41:09 +0000 (12:41 +0100)]
Add assert for non-NULL session

14 years agoLimit Proxy section current proxypass
Adam Dickmeiss [Wed, 10 Mar 2010 14:18:17 +0000 (15:18 +0100)]
Limit Proxy section current proxypass

14 years agoMerge branch 'thread_work_experiments'
Adam Dickmeiss [Thu, 4 Mar 2010 13:04:03 +0000 (14:04 +0100)]
Merge branch 'thread_work_experiments'

14 years agoLock client while modifying session
Adam Dickmeiss [Thu, 4 Mar 2010 13:01:41 +0000 (14:01 +0100)]
Lock client while modifying session

14 years agoCall reclist_destroy before NMEM is reset
Adam Dickmeiss [Thu, 4 Mar 2010 12:10:21 +0000 (13:10 +0100)]
Call reclist_destroy before NMEM is reset

14 years agoAvoid string concats
Jakub Skoczen [Thu, 4 Mar 2010 12:10:01 +0000 (13:10 +0100)]
Avoid string concats

14 years agoRender/clear HTML faster, bug #2856
Jakub Skoczen [Thu, 4 Mar 2010 11:46:40 +0000 (12:46 +0100)]
Render/clear HTML faster, bug #2856

Uses ideas from http://blog.stevenlevithan.com/archives/faster-than-innerhtml

14 years agoAdd reference counting for client
Adam Dickmeiss [Wed, 3 Mar 2010 14:19:31 +0000 (15:19 +0100)]
Add reference counting for client

14 years agoMore informative message for ingest failures
Adam Dickmeiss [Mon, 1 Mar 2010 13:38:07 +0000 (14:38 +0100)]
More informative message for ingest failures

14 years agoTry to void destroying a session that is in use
Adam Dickmeiss [Tue, 23 Feb 2010 11:25:07 +0000 (12:25 +0100)]
Try to void destroying a session that is in use

14 years agoAvoid using sessions when not needed
Adam Dickmeiss [Tue, 23 Feb 2010 11:23:15 +0000 (12:23 +0100)]
Avoid using sessions when not needed

14 years agoOptimize client_set_state for active state
Adam Dickmeiss [Tue, 23 Feb 2010 11:21:13 +0000 (12:21 +0100)]
Optimize client_set_state for active state

Function client_set_state no longer calls session_active_clients
to check whether active clients has reached zero - when the state
that is being set for the client parameter is already known to be
"active".

14 years agoHonor max_idle for non-fd IOCHANs
Adam Dickmeiss [Tue, 23 Feb 2010 11:17:49 +0000 (12:17 +0100)]
Honor max_idle for non-fd IOCHANs

Timeout specs for IOCHANs with non-fds (= -1) were not considered and
thus the real timeout was longer than specified (15 seconds). We
now use them and wait up to 300 seconds instead.

14 years agoFix mutex handling in host resolver
Adam Dickmeiss [Mon, 22 Feb 2010 15:45:27 +0000 (16:45 +0100)]
Fix mutex handling in host resolver

14 years agoFix IOCHAN destruction
Adam Dickmeiss [Mon, 22 Feb 2010 15:08:33 +0000 (16:08 +0100)]
Fix IOCHAN destruction

A new error was introduced approx 10 minutes ago.

14 years agoSimplify check for destructed IOCHAN
Adam Dickmeiss [Mon, 22 Feb 2010 15:01:13 +0000 (16:01 +0100)]
Simplify check for destructed IOCHAN

14 years agoSimplify IOCHAN destrouction
Adam Dickmeiss [Mon, 22 Feb 2010 14:57:04 +0000 (15:57 +0100)]
Simplify IOCHAN destrouction

14 years agoFix connection reuse
Adam Dickmeiss [Mon, 22 Feb 2010 13:51:28 +0000 (14:51 +0100)]
Fix connection reuse

Try to ensure we don't use a connection (for reuse) that is still
active. We must not reuse a connection (and ZOOM connection) if
events are still being fired to it.

14 years agoevents: fix event type being propagated
Adam Dickmeiss [Mon, 22 Feb 2010 13:48:30 +0000 (14:48 +0100)]
events: fix event type being propagated

Use combined mask of events for this_event member of IOCHAN (using
non-masked would overwrite previous value) . Ensire that only IOCHANs
for handled events are destroyed.

14 years agoUpdate to use perf.xml service
Adam Dickmeiss [Mon, 22 Feb 2010 13:46:38 +0000 (14:46 +0100)]
Update to use perf.xml service

14 years agoUpdate doc/common because of new entities
Adam Dickmeiss [Mon, 22 Feb 2010 08:53:57 +0000 (09:53 +0100)]
Update doc/common because of new entities

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Sun, 21 Feb 2010 18:52:39 +0000 (19:52 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoPerformance tests - bash based
Adam Dickmeiss [Sun, 21 Feb 2010 11:02:58 +0000 (12:02 +0100)]
Performance tests - bash based

14 years agoMany changes to installation sections.
Mike Taylor [Fri, 19 Feb 2010 17:34:42 +0000 (17:34 +0000)]
Many changes to installation sections.

14 years agoMany tweaks to installation sections.
Mike Taylor [Thu, 18 Feb 2010 17:51:44 +0000 (17:51 +0000)]
Many tweaks to installation sections.

14 years agoSeparate (brief) section on connectors.
Mike Taylor [Thu, 18 Feb 2010 17:02:30 +0000 (17:02 +0000)]
Separate (brief) section on connectors.

14 years agoAdd enclosing section for bulk of Introduction.
Mike Taylor [Thu, 18 Feb 2010 16:59:52 +0000 (16:59 +0000)]
Add enclosing section for bulk of Introduction.
Add myself to author list.

14 years agoChange all instances of AJAX into Ajax
Mike Taylor [Thu, 18 Feb 2010 14:31:38 +0000 (14:31 +0000)]
Change all instances of AJAX into Ajax

14 years agoChange "XML RPC" to "XML-based".
Mike Taylor [Thu, 18 Feb 2010 14:18:32 +0000 (14:18 +0000)]
Change "XML RPC" to "XML-based".

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Mike Taylor [Thu, 18 Feb 2010 14:00:50 +0000 (14:00 +0000)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoAdd a note on the name.
Mike Taylor [Thu, 18 Feb 2010 13:59:59 +0000 (13:59 +0000)]
Add a note on the name.

14 years agoRemove factual error
Jakub Skoczen [Thu, 18 Feb 2010 13:46:50 +0000 (14:46 +0100)]
Remove factual error

14 years agoDedupe.
Mike Taylor [Thu, 18 Feb 2010 13:42:45 +0000 (13:42 +0000)]
Dedupe.

14 years agoConsistently use the capitalisation AJAX rather than a mixture of Ajax
Mike Taylor [Thu, 18 Feb 2010 13:37:07 +0000 (13:37 +0000)]
Consistently use the capitalisation AJAX rather than a mixture of Ajax
and AJAX.

14 years agoConsistently use the capitalisation AJAX rather than a mixture of Ajax
Mike Taylor [Thu, 18 Feb 2010 13:36:52 +0000 (13:36 +0000)]
Consistently use the capitalisation AJAX rather than a mixture of Ajax
and AJAX.

14 years agoClarify introduction.
Mike Taylor [Thu, 18 Feb 2010 13:33:56 +0000 (13:33 +0000)]
Clarify introduction.

14 years agoProtect session_watch
Adam Dickmeiss [Wed, 17 Feb 2010 16:05:03 +0000 (17:05 +0100)]
Protect session_watch

14 years agoEvent manager do not produce log output by default
Adam Dickmeiss [Mon, 15 Feb 2010 12:17:01 +0000 (13:17 +0100)]
Event manager do not produce log output by default

Log level controlled by log_level member of iochan_man now.

14 years agosession.[ch] replaces logic.c, pazpar2.h
Adam Dickmeiss [Mon, 15 Feb 2010 12:07:26 +0000 (13:07 +0100)]
session.[ch] replaces logic.c, pazpar2.h

Because that's what this is about : sessions.

14 years agoMutex protect the session
Adam Dickmeiss [Mon, 15 Feb 2010 11:53:33 +0000 (12:53 +0100)]
Mutex protect the session

Access to the Pazpar2 session is now proteced with a Mutex. This,
for the first time, seems to produce a reasonably stable Pazpar2 in
threaded mode.

14 years agoMutex protect normalize_record cache
Adam Dickmeiss [Mon, 15 Feb 2010 11:38:20 +0000 (12:38 +0100)]
Mutex protect normalize_record cache

14 years agoAdd DAEMON setting in Deb defaults
Adam Dickmeiss [Mon, 15 Feb 2010 11:37:29 +0000 (12:37 +0100)]
Add DAEMON setting in Deb defaults

14 years agoThread safe use of qsort
Adam Dickmeiss [Fri, 12 Feb 2010 13:22:12 +0000 (14:22 +0100)]
Thread safe use of qsort

14 years agoProtect struct reclist
Adam Dickmeiss [Fri, 12 Feb 2010 13:10:50 +0000 (14:10 +0100)]
Protect struct reclist

14 years agoNew host list manager: database_hosts_t
Adam Dickmeiss [Fri, 12 Feb 2010 12:31:05 +0000 (13:31 +0100)]
New host list manager: database_hosts_t

14 years agoProtect struct host
Adam Dickmeiss [Fri, 12 Feb 2010 11:55:26 +0000 (12:55 +0100)]
Protect struct host

14 years agoRemove connection_freelist
Adam Dickmeiss [Fri, 12 Feb 2010 10:58:46 +0000 (11:58 +0100)]
Remove connection_freelist

14 years agoRemove two unused members from connection
Adam Dickmeiss [Fri, 12 Feb 2010 10:56:43 +0000 (11:56 +0100)]
Remove two unused members from connection

14 years agoiochan_man_t in logic.c gone
Adam Dickmeiss [Fri, 12 Feb 2010 10:49:56 +0000 (11:49 +0100)]
iochan_man_t in logic.c gone

Unfortunately we've found another static list: connection_freelist
in connection.c :-)

14 years agoclient freelist removed (thus thread safe now)
Adam Dickmeiss [Fri, 12 Feb 2010 10:11:15 +0000 (11:11 +0100)]
client freelist removed (thus thread safe now)

14 years agoHTTP session list thread safe
Adam Dickmeiss [Fri, 12 Feb 2010 10:07:15 +0000 (11:07 +0100)]
HTTP session list thread safe

14 years agoRename http functions
Adam Dickmeiss [Thu, 11 Feb 2010 14:42:54 +0000 (15:42 +0100)]
Rename http functions

14 years agoFix bug #3260 (dynamic/static settings mixed)
Adam Dickmeiss [Thu, 11 Feb 2010 13:52:07 +0000 (14:52 +0100)]
Fix bug #3260 (dynamic/static settings mixed)

14 years agoAdd test case for bug #3260 (settings mixed)
Adam Dickmeiss [Thu, 11 Feb 2010 10:15:51 +0000 (11:15 +0100)]
Add test case for bug #3260 (settings mixed)

14 years agoStarting HTTP session manager
Adam Dickmeiss [Wed, 10 Feb 2010 14:58:24 +0000 (15:58 +0100)]
Starting HTTP session manager

14 years agoHTTP free buffers handled by http_server_t
Adam Dickmeiss [Wed, 10 Feb 2010 13:54:30 +0000 (14:54 +0100)]
HTTP free buffers handled by http_server_t

Two non-thread safe lists now handled by http_server_t.

14 years agoAdd mutex for service (ref counting)
Adam Dickmeiss [Thu, 4 Feb 2010 14:38:57 +0000 (15:38 +0100)]
Add mutex for service (ref counting)

14 years agoNumber of worker-threads controlled by main config
Adam Dickmeiss [Wed, 3 Feb 2010 08:40:21 +0000 (09:40 +0100)]
Number of worker-threads controlled by main config

The number of worker-threads may be controlled by threads@number in main
config. A value of 0, disables worker-threads - and operates as older
versions of Pazpar2.

14 years agoUse icu_iter-functions (YAZ 4.0.2)
Adam Dickmeiss [Tue, 2 Feb 2010 21:12:16 +0000 (22:12 +0100)]
Use icu_iter-functions (YAZ 4.0.2)

14 years agoHighly experimental boss-worker socket handler
Adam Dickmeiss [Wed, 27 Jan 2010 15:52:08 +0000 (16:52 +0100)]
Highly experimental boss-worker socket handler

The eventl.h from old GFS/paraz is extended a bit. Socket notications
are sent via queues to a set of workers. Uses sel_thread. Currently
test_sel_thread passes.. Which itself tests sel_thread based on an
event handler that is ALSO using eventl. Now passes .. albeit the
work-flow gives me the creeps.

14 years agoCalling iochan_man_destroy
Adam Dickmeiss [Wed, 27 Jan 2010 15:46:14 +0000 (16:46 +0100)]
Calling iochan_man_destroy

14 years agoAdd indent footer
Adam Dickmeiss [Wed, 27 Jan 2010 09:23:41 +0000 (10:23 +0100)]
Add indent footer

14 years agoSmall IOCHAN refactor. Introduce iochan_man_t
Adam Dickmeiss [Wed, 27 Jan 2010 09:16:37 +0000 (10:16 +0100)]
Small IOCHAN refactor. Introduce iochan_man_t

14 years agoAdd load balancing section
Jakub Skoczen [Tue, 26 Jan 2010 15:40:19 +0000 (16:40 +0100)]
Add load balancing section

14 years agoUsing yaz_xml_include
Adam Dickmeiss [Tue, 26 Jan 2010 14:50:56 +0000 (15:50 +0100)]
Using yaz_xml_include

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 26 Jan 2010 14:40:00 +0000 (15:40 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoUse dirent wrapper of YAZ (eequires YAZ 4.0.1)
Adam Dickmeiss [Tue, 26 Jan 2010 14:39:33 +0000 (15:39 +0100)]
Use dirent wrapper of YAZ (eequires YAZ 4.0.1)

14 years agoFix leak WRT server@id attr
Adam Dickmeiss [Tue, 26 Jan 2010 14:38:52 +0000 (15:38 +0100)]
Fix leak WRT server@id attr

14 years agoAvoid mixed stmt/var declare
Adam Dickmeiss [Tue, 26 Jan 2010 14:37:43 +0000 (15:37 +0100)]
Avoid mixed stmt/var declare

14 years agoRequre YAZ 4.0.1 or later
Adam Dickmeiss [Tue, 26 Jan 2010 14:35:44 +0000 (15:35 +0100)]
Requre YAZ 4.0.1 or later

14 years agoAdd load_balancing config
Jakub Skoczen [Tue, 26 Jan 2010 14:02:24 +0000 (15:02 +0100)]
Add load_balancing config

14 years agoDocument server ID attribute
Adam Dickmeiss [Tue, 26 Jan 2010 13:42:55 +0000 (14:42 +0100)]
Document server ID attribute

14 years agoDont be so agressive when stopping pazpar2
Adam Dickmeiss [Tue, 26 Jan 2010 13:23:17 +0000 (14:23 +0100)]
Dont be so agressive when stopping pazpar2

Do not resort to killing all pazpar2 processes by PIDs when it
terminates happily with a signal sent to the PID. This change will
allow us to run multiple Pazpar2 servers using the same binary.

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 26 Jan 2010 12:10:58 +0000 (13:10 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoExtend init resp to include server ID, bug #3231
Adam Dickmeiss [Tue, 26 Jan 2010 12:09:57 +0000 (13:09 +0100)]
Extend init resp to include server ID, bug #3231

14 years agoDeb pkg pazpaz2-apache2 depends on pkg apache2
Adam Dickmeiss [Mon, 25 Jan 2010 21:50:27 +0000 (22:50 +0100)]
Deb pkg pazpaz2-apache2 depends on pkg apache2

pazpar2-apache2 now depends on virtual package apache2 rather than
apache2.2-common, so we get one of the apache2 servers as well.

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Mon, 25 Jan 2010 15:20:19 +0000 (16:20 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2