Adam Dickmeiss [Mon, 15 Mar 2010 14:21:30 +0000 (15:21 +0100)]
Refactor PP2 charsets handling, use pazpar2_mutex.
pp2_relvance_tokenize split into functions pp2_relvance_tokenize
and pp2_relevance_first. This allows ICU tokenize handlers to be
reused within a thread and makes ingest_to_cluster slightly faster.
Adam Dickmeiss [Mon, 15 Mar 2010 14:19:10 +0000 (15:19 +0100)]
Remove redundant decl
Adam Dickmeiss [Mon, 15 Mar 2010 14:18:42 +0000 (15:18 +0100)]
Requires YAZ 4.0.2
Adam Dickmeiss [Mon, 15 Mar 2010 14:17:07 +0000 (15:17 +0100)]
Add yaz_mutex_create wrapper - for debugging
Adam Dickmeiss [Mon, 15 Mar 2010 14:15:43 +0000 (15:15 +0100)]
Require YAZ 4.0.2 (due to ICU iter)
Adam Dickmeiss [Mon, 15 Mar 2010 14:09:15 +0000 (15:09 +0100)]
Add name parameter to iochan_create
Adam Dickmeiss [Fri, 12 Mar 2010 16:23:35 +0000 (17:23 +0100)]
Logging channels and mutexes + a few other things
Adam Dickmeiss [Fri, 12 Mar 2010 16:22:24 +0000 (17:22 +0100)]
Add WAIT between multi-sessions
Adam Dickmeiss [Fri, 12 Mar 2010 15:24:01 +0000 (16:24 +0100)]
Fix connection_is_idle test for idleness
Function connection_is_idle no longer returns 1 (idle) if
ZOOM_connection_peek_event returns ZOOM_EVENT_END. The problem is that
when this is returned another thread may still be chewing on a record.
Adam Dickmeiss [Fri, 12 Mar 2010 15:20:12 +0000 (16:20 +0100)]
More tuning for bash-based perf test
Adam Dickmeiss [Thu, 11 Mar 2010 14:44:17 +0000 (15:44 +0100)]
Fix SEGV: client.database reference
Ensure client.database (session_database) is set to NULL when it
is no longer associated with a session. If it is NULL, then function
client_get_URL will return "NOURL".
Adam Dickmeiss [Thu, 11 Mar 2010 13:58:24 +0000 (14:58 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Thu, 11 Mar 2010 13:57:33 +0000 (14:57 +0100)]
More complete pazpar2 conf cleanup
Adam Dickmeiss [Thu, 11 Mar 2010 13:56:34 +0000 (14:56 +0100)]
iochan_man_destroy destroys channels
Adam Dickmeiss [Thu, 11 Mar 2010 13:55:23 +0000 (14:55 +0100)]
Fix uninit var for session act
Adam Dickmeiss [Thu, 11 Mar 2010 13:54:53 +0000 (14:54 +0100)]
Add database_hosts_destroy
Jakub Skoczen [Thu, 11 Mar 2010 12:36:28 +0000 (13:36 +0100)]
Use proper extensions
Jakub Skoczen [Thu, 11 Mar 2010 12:32:13 +0000 (13:32 +0100)]
Remvoe jmeter.log
And introduce changes reported in the previous commit.
Jakub Skoczen [Thu, 11 Mar 2010 12:27:18 +0000 (13:27 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Jakub Skoczen [Thu, 11 Mar 2010 12:26:09 +0000 (13:26 +0100)]
Hit pazpar2 directly (no apache)
Also use 40 threads (loop 10 times) and retrieve 50 recs
Jakub Skoczen [Thu, 11 Mar 2010 12:25:44 +0000 (13:25 +0100)]
Add results for jmeter run.
Adam Dickmeiss [Thu, 11 Mar 2010 12:01:51 +0000 (13:01 +0100)]
YLOG_DEBUG for stmt in client_incref
Adam Dickmeiss [Thu, 11 Mar 2010 11:41:59 +0000 (12:41 +0100)]
Release record block on show after first chunk
The client and connection code now fires SESSION_WATCH_SHOW and
SESSION_WATCH_RECORD after all non-blocking events has been received
from some client. Previously this was done on first record received.
Fixes #3318.
Adam Dickmeiss [Thu, 11 Mar 2010 11:41:09 +0000 (12:41 +0100)]
Add assert for non-NULL session
Adam Dickmeiss [Wed, 10 Mar 2010 14:18:17 +0000 (15:18 +0100)]
Limit Proxy section current proxypass
Adam Dickmeiss [Thu, 4 Mar 2010 13:04:03 +0000 (14:04 +0100)]
Merge branch 'thread_work_experiments'
Adam Dickmeiss [Thu, 4 Mar 2010 13:01:41 +0000 (14:01 +0100)]
Lock client while modifying session
Adam Dickmeiss [Thu, 4 Mar 2010 12:10:21 +0000 (13:10 +0100)]
Call reclist_destroy before NMEM is reset
Jakub Skoczen [Thu, 4 Mar 2010 12:10:01 +0000 (13:10 +0100)]
Avoid string concats
Jakub Skoczen [Thu, 4 Mar 2010 11:46:40 +0000 (12:46 +0100)]
Render/clear HTML faster, bug #2856
Uses ideas from http://blog.stevenlevithan.com/archives/faster-than-innerhtml
Adam Dickmeiss [Wed, 3 Mar 2010 14:19:31 +0000 (15:19 +0100)]
Add reference counting for client
Adam Dickmeiss [Mon, 1 Mar 2010 13:38:07 +0000 (14:38 +0100)]
More informative message for ingest failures
Adam Dickmeiss [Tue, 23 Feb 2010 11:25:07 +0000 (12:25 +0100)]
Try to void destroying a session that is in use
Adam Dickmeiss [Tue, 23 Feb 2010 11:23:15 +0000 (12:23 +0100)]
Avoid using sessions when not needed
Adam Dickmeiss [Tue, 23 Feb 2010 11:21:13 +0000 (12:21 +0100)]
Optimize client_set_state for active state
Function client_set_state no longer calls session_active_clients
to check whether active clients has reached zero - when the state
that is being set for the client parameter is already known to be
"active".
Adam Dickmeiss [Tue, 23 Feb 2010 11:17:49 +0000 (12:17 +0100)]
Honor max_idle for non-fd IOCHANs
Timeout specs for IOCHANs with non-fds (= -1) were not considered and
thus the real timeout was longer than specified (15 seconds). We
now use them and wait up to 300 seconds instead.
Adam Dickmeiss [Mon, 22 Feb 2010 15:45:27 +0000 (16:45 +0100)]
Fix mutex handling in host resolver
Adam Dickmeiss [Mon, 22 Feb 2010 15:08:33 +0000 (16:08 +0100)]
Fix IOCHAN destruction
A new error was introduced approx 10 minutes ago.
Adam Dickmeiss [Mon, 22 Feb 2010 15:01:13 +0000 (16:01 +0100)]
Simplify check for destructed IOCHAN
Adam Dickmeiss [Mon, 22 Feb 2010 14:57:04 +0000 (15:57 +0100)]
Simplify IOCHAN destrouction
Adam Dickmeiss [Mon, 22 Feb 2010 13:51:28 +0000 (14:51 +0100)]
Fix connection reuse
Try to ensure we don't use a connection (for reuse) that is still
active. We must not reuse a connection (and ZOOM connection) if
events are still being fired to it.
Adam Dickmeiss [Mon, 22 Feb 2010 13:48:30 +0000 (14:48 +0100)]
events: fix event type being propagated
Use combined mask of events for this_event member of IOCHAN (using
non-masked would overwrite previous value) . Ensire that only IOCHANs
for handled events are destroyed.
Adam Dickmeiss [Mon, 22 Feb 2010 13:46:38 +0000 (14:46 +0100)]
Update to use perf.xml service
Adam Dickmeiss [Mon, 22 Feb 2010 08:53:57 +0000 (09:53 +0100)]
Update doc/common because of new entities
Adam Dickmeiss [Sun, 21 Feb 2010 18:52:39 +0000 (19:52 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Sun, 21 Feb 2010 11:02:58 +0000 (12:02 +0100)]
Performance tests - bash based
Mike Taylor [Fri, 19 Feb 2010 17:34:42 +0000 (17:34 +0000)]
Many changes to installation sections.
Mike Taylor [Thu, 18 Feb 2010 17:51:44 +0000 (17:51 +0000)]
Many tweaks to installation sections.
Mike Taylor [Thu, 18 Feb 2010 17:02:30 +0000 (17:02 +0000)]
Separate (brief) section on connectors.
Mike Taylor [Thu, 18 Feb 2010 16:59:52 +0000 (16:59 +0000)]
Add enclosing section for bulk of Introduction.
Add myself to author list.
Mike Taylor [Thu, 18 Feb 2010 14:31:38 +0000 (14:31 +0000)]
Change all instances of AJAX into Ajax
Mike Taylor [Thu, 18 Feb 2010 14:18:32 +0000 (14:18 +0000)]
Change "XML RPC" to "XML-based".
Mike Taylor [Thu, 18 Feb 2010 14:00:50 +0000 (14:00 +0000)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Mike Taylor [Thu, 18 Feb 2010 13:59:59 +0000 (13:59 +0000)]
Add a note on the name.
Jakub Skoczen [Thu, 18 Feb 2010 13:46:50 +0000 (14:46 +0100)]
Remove factual error
Mike Taylor [Thu, 18 Feb 2010 13:42:45 +0000 (13:42 +0000)]
Dedupe.
Mike Taylor [Thu, 18 Feb 2010 13:37:07 +0000 (13:37 +0000)]
Consistently use the capitalisation AJAX rather than a mixture of Ajax
and AJAX.
Mike Taylor [Thu, 18 Feb 2010 13:36:52 +0000 (13:36 +0000)]
Consistently use the capitalisation AJAX rather than a mixture of Ajax
and AJAX.
Mike Taylor [Thu, 18 Feb 2010 13:33:56 +0000 (13:33 +0000)]
Clarify introduction.
Adam Dickmeiss [Wed, 17 Feb 2010 16:05:03 +0000 (17:05 +0100)]
Protect session_watch
Adam Dickmeiss [Mon, 15 Feb 2010 12:17:01 +0000 (13:17 +0100)]
Event manager do not produce log output by default
Log level controlled by log_level member of iochan_man now.
Adam Dickmeiss [Mon, 15 Feb 2010 12:07:26 +0000 (13:07 +0100)]
session.[ch] replaces logic.c, pazpar2.h
Because that's what this is about : sessions.
Adam Dickmeiss [Mon, 15 Feb 2010 11:53:33 +0000 (12:53 +0100)]
Mutex protect the session
Access to the Pazpar2 session is now proteced with a Mutex. This,
for the first time, seems to produce a reasonably stable Pazpar2 in
threaded mode.
Adam Dickmeiss [Mon, 15 Feb 2010 11:38:20 +0000 (12:38 +0100)]
Mutex protect normalize_record cache
Adam Dickmeiss [Mon, 15 Feb 2010 11:37:29 +0000 (12:37 +0100)]
Add DAEMON setting in Deb defaults
Adam Dickmeiss [Fri, 12 Feb 2010 13:22:12 +0000 (14:22 +0100)]
Thread safe use of qsort
Adam Dickmeiss [Fri, 12 Feb 2010 13:10:50 +0000 (14:10 +0100)]
Protect struct reclist
Adam Dickmeiss [Fri, 12 Feb 2010 12:31:05 +0000 (13:31 +0100)]
New host list manager: database_hosts_t
Adam Dickmeiss [Fri, 12 Feb 2010 11:55:26 +0000 (12:55 +0100)]
Protect struct host
Adam Dickmeiss [Fri, 12 Feb 2010 10:58:46 +0000 (11:58 +0100)]
Remove connection_freelist
Adam Dickmeiss [Fri, 12 Feb 2010 10:56:43 +0000 (11:56 +0100)]
Remove two unused members from connection
Adam Dickmeiss [Fri, 12 Feb 2010 10:49:56 +0000 (11:49 +0100)]
iochan_man_t in logic.c gone
Unfortunately we've found another static list: connection_freelist
in connection.c :-)
Adam Dickmeiss [Fri, 12 Feb 2010 10:11:15 +0000 (11:11 +0100)]
client freelist removed (thus thread safe now)
Adam Dickmeiss [Fri, 12 Feb 2010 10:07:15 +0000 (11:07 +0100)]
HTTP session list thread safe
Adam Dickmeiss [Thu, 11 Feb 2010 14:42:54 +0000 (15:42 +0100)]
Rename http functions
Adam Dickmeiss [Thu, 11 Feb 2010 13:52:07 +0000 (14:52 +0100)]
Fix bug #3260 (dynamic/static settings mixed)
Adam Dickmeiss [Thu, 11 Feb 2010 10:15:51 +0000 (11:15 +0100)]
Add test case for bug #3260 (settings mixed)
Adam Dickmeiss [Wed, 10 Feb 2010 14:58:24 +0000 (15:58 +0100)]
Starting HTTP session manager
Adam Dickmeiss [Wed, 10 Feb 2010 13:54:30 +0000 (14:54 +0100)]
HTTP free buffers handled by http_server_t
Two non-thread safe lists now handled by http_server_t.
Adam Dickmeiss [Thu, 4 Feb 2010 14:38:57 +0000 (15:38 +0100)]
Add mutex for service (ref counting)
Adam Dickmeiss [Wed, 3 Feb 2010 08:40:21 +0000 (09:40 +0100)]
Number of worker-threads controlled by main config
The number of worker-threads may be controlled by threads@number in main
config. A value of 0, disables worker-threads - and operates as older
versions of Pazpar2.
Adam Dickmeiss [Tue, 2 Feb 2010 21:12:16 +0000 (22:12 +0100)]
Use icu_iter-functions (YAZ 4.0.2)
Adam Dickmeiss [Wed, 27 Jan 2010 15:52:08 +0000 (16:52 +0100)]
Highly experimental boss-worker socket handler
The eventl.h from old GFS/paraz is extended a bit. Socket notications
are sent via queues to a set of workers. Uses sel_thread. Currently
test_sel_thread passes.. Which itself tests sel_thread based on an
event handler that is ALSO using eventl. Now passes .. albeit the
work-flow gives me the creeps.
Adam Dickmeiss [Wed, 27 Jan 2010 15:46:14 +0000 (16:46 +0100)]
Calling iochan_man_destroy
Adam Dickmeiss [Wed, 27 Jan 2010 09:23:41 +0000 (10:23 +0100)]
Add indent footer
Adam Dickmeiss [Wed, 27 Jan 2010 09:16:37 +0000 (10:16 +0100)]
Small IOCHAN refactor. Introduce iochan_man_t
Jakub Skoczen [Tue, 26 Jan 2010 15:40:19 +0000 (16:40 +0100)]
Add load balancing section
Adam Dickmeiss [Tue, 26 Jan 2010 14:50:56 +0000 (15:50 +0100)]
Using yaz_xml_include
Adam Dickmeiss [Tue, 26 Jan 2010 14:40:00 +0000 (15:40 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 26 Jan 2010 14:39:33 +0000 (15:39 +0100)]
Use dirent wrapper of YAZ (eequires YAZ 4.0.1)
Adam Dickmeiss [Tue, 26 Jan 2010 14:38:52 +0000 (15:38 +0100)]
Fix leak WRT server@id attr
Adam Dickmeiss [Tue, 26 Jan 2010 14:37:43 +0000 (15:37 +0100)]
Avoid mixed stmt/var declare
Adam Dickmeiss [Tue, 26 Jan 2010 14:35:44 +0000 (15:35 +0100)]
Requre YAZ 4.0.1 or later
Jakub Skoczen [Tue, 26 Jan 2010 14:02:24 +0000 (15:02 +0100)]
Add load_balancing config
Adam Dickmeiss [Tue, 26 Jan 2010 13:42:55 +0000 (14:42 +0100)]
Document server ID attribute
Adam Dickmeiss [Tue, 26 Jan 2010 13:23:17 +0000 (14:23 +0100)]
Dont be so agressive when stopping pazpar2
Do not resort to killing all pazpar2 processes by PIDs when it
terminates happily with a signal sent to the PID. This change will
allow us to run multiple Pazpar2 servers using the same binary.
Adam Dickmeiss [Tue, 26 Jan 2010 12:10:58 +0000 (13:10 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 26 Jan 2010 12:09:57 +0000 (13:09 +0100)]
Extend init resp to include server ID, bug #3231
Adam Dickmeiss [Mon, 25 Jan 2010 21:50:27 +0000 (22:50 +0100)]
Deb pkg pazpaz2-apache2 depends on pkg apache2
pazpar2-apache2 now depends on virtual package apache2 rather than
apache2.2-common, so we get one of the apache2 servers as well.
Adam Dickmeiss [Mon, 25 Jan 2010 15:20:19 +0000 (16:20 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2