3 Fix dead lock in session_shared (init) MP-605
7 Fix session_shared caches set with diagnostic MP-604
9 Fix assertion failed in session_shared filter MP-603
11 Make /usr/share/metaproxy be part of metaproxy RPM MP-601
13 Log YAZ version upon start MP-599
17 sru_z3950: undo Serialize identical SRU GET requests MP-598
18 Now much more elegantly handled by session_shared.
20 session_shared: anticipated init and search MP-597
22 z3950_client: separate init timeout MP-596
23 Both init-timeout and connect-timeout are configurable by this change.
24 Default is 10 seconds.
28 zoom: support cf_-params MP-595
30 http_client: returns 404 if no destination URI is given
34 zoom: allow / in user and password db args MP-592
38 Log rotate no longer reloads configuration - instead Metaproxy just
39 re-opens log files when SIGHUP is received. MP-485
41 Debian : init.d metaproxy reload should check configuration MP-591
43 Fix Metaproxy stops logging after check config failed MP-590
47 Fix double free in log filter (with incorrect config) MP-589
49 zoom: Add allow_ip feature - fixes MP-588
50 Allow a list of IPs to be given separated by blanks
51 <allow auth_url="http://mkc-admin.indexdata.com/..."
52 allow_ip="127.0.0.1 ::1" .. >
54 cql2pqf.txt: Maps dc.subject to Bib-1 21 rather than 47
56 zoom: fix CS write-check
60 zoom: handle contentAuthentication MP-587
64 Destroy router and filters in parent process MP-584
66 Update NMAKE makefile to use Visual Studio 2013 along with Boost 1.57,
67 ICU 54.1, Libxml2 2.9.2, Libxslt 1.1.28.
71 Use YAZ backtrace facility MP-582
73 Fix libmetaproxy-dev depends on libgnutls-dev - MP-580
74 libgnutls-dev is unavailable on jessie.
76 Update template filter to avoid Pimpl MP-579
78 cgi: POSTed content - part of MP-562
80 Fix filter cgi does not relay session close MP-577
84 Add support for binding outgoing IP for http_client and z3950_client
85 This is enabled by bind_host setting. MP-575
89 z3950_client: allows negotiation charset to be set MP-574
91 cgi: more functional but no support for POSTed content yet (part of MP-564)
95 http_file: add include of sys/stat.h fixes MP-576
97 Fix documentation about SRU client support MP-572
99 Initialize Libxml2 - for threaded operation MP-571
101 --- 1.5.10 2014/08/26
103 On SIGTERM shut down connection+listening sockets MP-568
104 This fixes a problem with 'metaproxy stop' sometimes taking a long time.
108 zoom: make retry on failure configurable MP-565
109 The default and existing behavior is that backend failures (any
110 diagnostic) makes the module re-search once. The behavior may
111 be changed by db parameter 'retry'. If given value '0' disables
112 retry and '1' enables it. If not given, the Torus record may
113 specify with element retryOnFailure (value '0'/'1').
117 Fix race condition in SIGTERM handling. Could terminate whole metaproxy
118 instead of just a child process. Extremely rare in real life, hit me with
119 CF stress testing. MP-559.
123 http_file: passthru option MP-557
124 New facility for http_file to passthru - even if an area is matched. The
125 default behavior (passthru=false) is to return 404: Not found. With
126 passthru=false, next filter is consulted.
130 Fix ref to freed memory in log filter 1line - MP-556
132 echoedSearchRetrieveRequest support MP-555
136 zoom: allow hostname to be given for ipauth MP-552
137 The Torus setting for that is called auth_hostname.
141 zoom: IP auth use field "ipRanges" rather than "ip" MP-551
145 session_shared: close in ~BackendInstance MP-549
146 This fixes a serious issue where some MP would leak sockets.
148 session_shared: mutex lock in BackendClass::release_backend MP-550
149 Fixes a SEGV that could occur (in rare cases).
153 zoom: Do not include ZOOM C's fake surrogate diag recs MP-547
155 zoom: fix invalid present response in some cases MP-546
157 zoom: Relay Torus HTTP error message
161 Check for proper limits before using RecordCache functions MP-544
165 Build packages for Ubuntu Trusty Tahr 14.04 LTS
167 sort: crash / invalid_read in filter sort MP-541
169 sru_z3950: facet should be stored in additionalSearchInfo MP-533
171 doc: fix missing man pages MP-542
173 cql_rpn: fix threading problem with CQL to RPN conversion MP-497
175 cql_rpn: allow conversion from RPN to CQL (reverse) MP-537
179 sru_z3950: fix facet response (memory corruption) MP-532
181 log: fix crash idPass user is omitted MP-530
185 query_rewrite: pass-thru non Type-1 queries MP-527
187 metaproxy stop (SIGTERM) kills all child processes spanwed by
188 filter (if any) before invoking filter destructors. MP-525
192 http_file: only supports HTTP GET MP-523
194 session_shared: shut down expire thread in destructor
195 This ensures that expire thread is not running after destruction
196 and does bad memory references, etc.
198 frontend_net: fix segfault on startup MP-524
199 Would happen if MP was listening on multiple ports and one
200 of the ports was already in use (and MP would exit).
202 frontend_net: fix memory leak MP-521
203 This leak would occur if all sessions were in use and the input
204 queue was cleared when a client would close connection (socket).
206 frontend_net: fix compilation on Windows (SIGUSR1 does not exist)
210 http_rewrite: use local skiplist; fixes memory corruption. MP-520
212 http_client: x-forwarded-for controls X-Forwarded-For presence
213 If x-forwarded-for setting (boolean) is enabled, http_client will
214 generate an X-Forwarded-For header entry which includes existing
215 X-Forwarded-For (if any) and current peer address (immediate client
216 of Metaproxy). By default x-forwarded-for disabled and X-Forwarded-For
217 will not be generated.
219 z3950_client: client_ip controls client-IP presence
220 If client_ip setting (boolean) is enabled, z3950_client will
221 generate a client_ip OID as part of init request which includes
222 previous client_ip (if any) and current peer address (immediate
223 client of Metaproxy). By default client_ip is disabled and client_ip
224 will not be generated.
226 HTTP X-Forwarded-For/Z39.50 Client-IP support
227 virt_db, multi: relays Z39.50 client-IP.
228 sru_z3950: converts X-Forwarded-For header to Z39.50 client-IP.
229 zoom: uses Client-IP or origin address (prefer Client-IP).
230 frontend_net: Strips tcp: from peer address (so that it is no longer
231 printed and stripped in zoom filter).
232 z3950_client: builds client-IP list - combining immediate peer address
233 as returned by COMSTACK and existing client-IP list (if avaiable).
234 The Origin only printes first X-Forwarded address.
238 Log when SIG{TERM,USR1} is received ASAP MP-513
239 Do it in frontend_net event loop rather than in place for metaproxy
240 main, which only exits when all sessions are terminated for SIGUSR1
243 metaproxy-config: quote some RHS values (that might include blanks)
245 Fix leak in sru_z3950 filter - when explain is returned MP-511
247 Allow stylesheet to be given for sru_z3950 filter MP-510
248 This is based on a patch by Sven Porst and the functionality
249 of the YAZ Generic Frontend Server.
251 Allow base attribute in configuration file tags - the attributes are
252 inserted by XInclude usage as mentioned on
253 yazlist: http://lists.indexdata.dk/pipermail/yazlist/2012-Au
254 and noted in a gist: https://gist.github.com/3551094
256 Package metaproxy provides virtual package metaproxy6 MP-508
257 This allows module packages to depend on a metaproxy server
260 Filter destructors called upon daemon termination MP-505
261 When metaproxy daemon receives SIGTERM the stop method of each filter
262 is called. The stop method existed before, but did not take any
263 arguements (void).. The frontend_net filter can now distinguish
264 between SIGUSR1 (stop bind, but keep sessions running) and SIGTERM
265 (stop immediately). Note that this changes the API+ABI of Metaproxy
268 zoom: sync up with Pazpar2 WRT authentication handling MP-492
270 Router: use shared_ptr rather than naked one - to avoid leak if an
271 exception is thrown in configure.
275 zoom: Add nocproxy=1 for contentConnector sessions MP-501
277 Doc: mention proper versions; fix link to Boost win binaries.
279 Windows: update for Boost 1.55
281 Windows: avoid warning when using boost::split. Done by defining
282 _SCL_SECURE_NO_WARNINGS for Visual Studio.
284 Fix LSB conformance for /etc/init.d/metaproxy MP-500
285 Debian: add support for /etc/init.d/metaproxy status
287 sort: Add const to Record less than operator in order to compile on
292 session_shared: fix element-set handling in record caching. MP-499
294 document http_rewrite. MP-468
296 http_write: Honor X-Metaproxy-SkipLink MP-479 . Filter understands and
297 respects the header (which will normally come from the cproxy filter)
301 RPM: fix dependency for libmetaproxy5-devel MP-496. The libmetaproxy5-devel
302 RPM was unsable in version 1.4.0.
304 Remove log message about "backend classes". Appeared in version 1.4.0.
308 Build RPM/Deb packages with YAZ 5 and yazpp 1.5. Metaproxy still compiles
309 with older version from source, but packages now use YAZ 5 that supports
312 sru_z3950: Fix SEGV for decoding invalid SRU requests
313 Incorrect reference to union (was explain response rather than
316 session_shared: match additionalSearchInfo (includes facets). In
317 layman's terms means that means that facets are properly handled
318 by this filter. Eg a change in requested facets will issue new
319 search and facets from exisiting result set are cached.
321 --- 1.3.62 2013/09/11
323 http_rewrite: better handling of <script> content in HTML parser. MP-486
325 http_rewrite: fix threading issue with regex. MP-482
327 bounce: don't use strdup for fixed length content. Error occurred in echo
330 session_shared: expire backend class when no instances left. This
331 means memory clean up, but not really a leak fix.
333 virt_db: fix leak for naked ptr.
335 cql_rpn: use config relative path for cql2rpn file. MP-481
337 Updates for upcoming YAZ 5.
339 --- 1.3.61 2013/08/29
341 New configuration directories ports.d/routes.d for metaproxy
342 configuration. This allows 3rd party packages to install config
343 for ports and new routes. MP-477
345 --- 1.3.60 2013/08/21
347 Fix metaproxy-config --libs to return non-mt over mt libs.
348 The -mt versions do not exist as shared objects and cause
349 linker errors for applications linking with Metaproxy.
350 Problem present in versions 1.3.56 - 1.3.59. MP-475
352 HTML: clean up char checks. Add ptr to HTML parse spec
354 HTML parser stops eating tag when <-char is met MP-473
356 rewrite: do not even compare content types, if we don't have any
357 the regex_match caused a segfault if we had no content-type in the
360 rewrite: within header=... matches only the header value
361 Used to match the whole header line, but we need to use
362 ^$ anchoring for host-relative regexps, and they need to
363 anchor at the ends of the value. MP-470.
365 rewrite: Ruleset functional MP-469
367 --- 1.3.59 2013/07/12
369 session_shared: negotiate init sz parameters.
370 By default, session_shared will honor the paramters given by client.
371 An alternative, but not implemented, algorithm would be to only
372 re-use sessions with same sz parameters. This however, could reduce
373 re-use of sessions a lot. Hence this, simple algorithm instead. The
374 negotiation to a maximum sz values can be enabled by using
375 <init maximum-record-size="sz1" preferred-message-size="sz2"/>
376 in configuration. This will make session_shared send those values
377 to backends and use returned init values in negotaition to
378 client before session_shared.
380 session_shared: resolve result-set references.
381 The reference is substitued with the query for old set if database
382 match and query type is Type-1. If not the reference will issue a
385 sort filter: relays RecordComposition including elementSet in use for
388 http_client: better diagnostics
390 http_client: disables HTTP redirect handling by default.
391 It can be configured with max-redirects in configuration.
393 --- 1.3.58 2013/06/12
395 Fix loading of filters cql_rpn and sru_z3950 . Was broken by 1.3.57.
397 --- 1.3.57 2013/06/12
399 Make RouterChain and RouterXML part of public API (libmetaproxy).
401 http_client: honor X-Metaproxy-Proxy as an alternative to
402 the "proxy" configuration. Allows proxy to be set per HTTP request.
404 sru_z3950: For SRU requests recognize x-client prefixes as a way
405 to ingest "database parameters".. The suffix of x-client- serves
406 as database argument name. Multiple may be given. For example:
407 http://path/db/?operation=searchRetrieve&x-client-user=a&x-client-password=b
408 is turned into Z39.50 database
411 --- 1.3.56 2013/05/27
413 New filter present_chunk. This filter allows splitting of present requests into smaller chunks.
415 New filter sd_remove, which replaces surrogate diagnostics with
416 SUTRS records. This filter tries to deal with clients that breaks
417 when receiving surrogate diagnostics.
419 new filter http_client. Same role as z3950_client, but just for
420 HTTP. Allows Metaproxy to operate as a HTTP proxy.
422 New filter http_rewrite1, which serves as purpose on how to rewrite
423 HTTP content with Metaproxy.
425 Use libboost-system if available, because newer versions of libboost-threads
426 requires libboost-system.
428 Allow frontend_net to serve SSL/HTTPS, because we can specify a server
431 --- 1.3.55 2013/04/10
433 zoom: Torus setting: authenticationMode which may hold values "basic"
436 --- 1.3.54 2013/03/27
438 configure: check for Libxslt support in YAZ and rely on definitions
439 from yaz-config, rather than doing own xslt/xml2 checks.
441 Allow timestamp format for log lines to be given with option -m
442 for metaproxy. Similar to yaz-ztest/GFS option -m.
444 Document log category 'line' for log filter.
446 Solr configuration example in etc/config-solr.xml
448 multi: do not mess with request package. For scan and search,
449 database-names were modified and the request package was left with
450 dangling pointers that caused a log filter to fail (request package
451 inspected after multi was invoked).
453 Documentation: fix id of metaproxy-config ref .
455 Documentation: update for USEMARCON support.
457 --- 1.3.53 2013/01/31
459 record_transform: allow OPACXML to OPAC conversion
461 zoom: document content-proxy
463 zoom: document db parm content-{user,password}, torus_url. Also
464 <torus auth_url="..> which makes zoom operate in authenticated mode
467 --- 1.3.52 2012/11/30
469 zoom: fix http://-check. SRU search broken in 1.3.51.
471 --- 1.3.51 2012/11/15
473 zoom: only append http:// for SRU if not already given . Makes it
474 possible to use https-URLs.
476 Use yazpp 1.4 or later due to new ABI.
478 frontend_net: allow max package size to be specified. Controlled by
479 attribute 'max_recv_bytes' of element 'port'.
481 --- 1.3.50 2012/10/29
483 For most generated diagnostics by filters, typically temporary
484 system error, augment addinfo message with filter name.
486 Add support for CentOS 6 packages.
488 sru_z3950: interpret Z39.50 diagnostics part of Init Response.
490 Add man page for metaproxy-config.
492 --- 1.3.49 2012/10/18
494 zoom: new config element passthru. This defines an element set that is
495 passed verbatim to the backend in pz2 mode.
497 auth_simple: allow both idPass and open auth. Also fix SEGV that could
500 --- 1.3.48 2012/10/08
502 z3950_client: fix string handling for init diagnostics in the case where
505 query_rewrite: no charset conversion for error queries. Avoid performing
506 charset conversion for query conversion errors. The resulting Type-1
507 query is invalid in this case.
509 --- 1.3.47 2012/10/04
511 For graceful stop (SIGUSR1), metaproxy will kill children processes.
513 Log when metaproxy is invoked in test mode (-t).
515 Log PID for each log message.
517 multi: combine both NSDs and multiple NSDs into one (diagnostics).
519 z3950_client: fixup multiple NSD's too. Like surrogate diagnostics,
520 a (backend=target) is appended for each diagnostic so that can be
521 determined the origin of error.
523 multi: hideerrors also in use for present response.
525 Solr example in zoom man page.
527 Fix typo in query_rewrite config example.
529 Log at least first non surrogate diagnostic. Instead of
530 "Z_Records_multipleNSD"
532 multi: Fix check for opt Records in present response. A SEGV could occur
533 if a target did not return records and no diagnostics.
535 --- 1.3.46 2012/09/24
537 Yet another fix for graceful stop.
539 --- 1.3.45 2012/09/12
541 sru_z3950: relay surrogate diagnostics.
543 --- 1.3.44 2012/09/10
545 zoom: Honor extraArgs, strip # in zurl.
547 multi: fix SEGV for scan. Reported by Rustam T. Usmanov.
549 zoom: url_recipe allow %{var[reg]} substitutions.
550 It's like ${var[reg]} but does URI component encoding as well.
552 --- 1.3.43 2012/08/22
554 RPM/Deb: require yazpp 1.3.2, because it fixes a missing close of
555 non-keepalive HTTP sessions.
557 http_file: allow zero size files (bug fix)
559 Fix zoom schema: auth_url is optional
561 --- 1.3.42 2012/08/20
563 zoom: fix un-init memory (could result in SEGV at session close)
565 frontend_net: handle X-Forwarded-For. This is stored in package.origin()
566 and may be used in filters as usual.
568 zoom: authentication via Torus lookup
569 Enabled by new configuration setting: auth_url . If this is defined,
570 the zoom module will contact Torus for auth/IP lookup and that will
571 define realm to be used in session.
573 --- 1.3.41 2012/08/10
575 virt_db: Fix database name - first character we removed by mistake.
576 Bug introduced in 1.3.40.
578 --- 1.3.40 2012/08/06
580 virt_db: Don't use "unix path" as database for Unix sockets.
582 --- 1.3.39 2012/08/02
584 z3950_client: Don't tamper with / in zurl - fixes problems
585 using Unix sockets for backends.
587 session_shared: fix integer overflow problem with hit count.
589 session_shared: avoid long usage of cached queries.
591 zoom: New database argument , torus_url to set URL of Torus
592 record to be fetched.
594 --- 1.3.38 2012/07/04
596 Fixes for 'metaproxy reload' for RPM/Debian packages.
598 zoom: Allow rpn2cql conversion to be augmented with a properties file.
599 Element rpn2cql can be specified per-target for the zoom filter.
601 log: New category "line" which is a single-line log message with
602 most important parts of a HTTP/Z39.50 request/response.
604 --- 1.3.37 2012/06/01
606 frontend_net: add facility to report live statistics about response
607 times and current thread usage. The report is an XML document
608 and is triggered for a specific URL path. This is set by <stat-req>
609 in the configuration of frontend_net. By default this report is
610 disabled (same as empty value for <stat-req>).
612 Fix reload problem in init.d script for RPM/Debian.
613 The '/etc/init.d/metaproxy reload' in some cases would stop but not
614 start metaproxy - effectively stopping the service.
616 Don't display start log message when config testing (-t).
618 zoom: avoid CCL message limit of 1K in ZOOM filter.
620 --- 1.3.36 2012/05/10
622 metaproxy init script reacts to reload which does graceful stop +
623 start and is used by logrorate script.
625 --- 1.3.35 2012/05/09
627 Fixes for Windows compilation.
629 Metaproxy daemon reacts to SIGUSR1 in which case it will leave
630 existing sessions running but terminate the monitor process that is
631 used in keepalive mode.
633 Change start log message to 'metaproxy start'. Was 'Metaproxy start'
634 before. Consistent with 'metaproxy stop' message.
636 zoom: document zoom's proxy_timeout
638 z3950_client: fixup addinfo for init response
640 virt_db: return other diagnostic if init is rejected. Diagnostic 236:
641 "Access to specified database denied" is returned, but only if init
642 response from backend does not carry diagnostics already.
644 multi: relays user info for first rejected target. The other-information
645 field for init response for first rejected target is in common init
646 response. This ensures that some backend init diagnostics are returned to
649 --- 1.3.34 2012/04/25
651 frontend_log: extend logging (when message is given in config).
653 --- 1.3.33 2012/04/25
655 zoom: Fix check for proxy. Use diagnostic 1074 for proxy failures.
657 --- 1.3.32 2012/04/24
659 sru_z3950 filter passes through incoming Z39.50 requests again. Was
660 not handled by mistake in Metaproxy versions 1.3.29, 1.3.30 and 1.3.31.
662 --- 1.3.31 2012/04/24
664 zoom: fixes for retry/proxy failover logic. More logging.
666 --- 1.3.30 2012/04/23
668 zoom: return addinfo="proxy failure" for proxy failures. This also
669 changes the scheme for dealing with proxies a bit. zoom now always
670 do proxy check, even if there's no failover. Fortunately, that's not
673 zoom: Init rejected wo diagnostics maps to Bib-1:1014.
674 Bib-1 1014, "Init/AC: Authentication System error", seems pretty
675 generic. We don't know why the init would fail; IP, user, block IP, etc.
676 sru_z3950 filter maps this to SRU diagnostic 3: "Authentication error".
678 zoom: guess if invalid SRU response was an auth failure
680 session_shared: disable session retry by default . Can be enabled by
681 restart="true" in resultset section.
683 --- 1.3.29 2012/04/18
685 zoom: may read cf-proxy's config settings.
686 This reduces manual configuration of the content proxy server host.
687 The ZOOM module will use the old style session.proxyhost if "server"
688 is given (deprecated) and use the new style proxyhost/session if
689 "config_file" is in use.
691 frontend_net: remove incoming requests that can not be handled
692 Requests in queue for filter frontend_net are removed if client
693 closes connection for the session and request is not yet handled.
695 sru_z3950: serialize requests. This is to ensure that pipelined
696 HTTP requests are handled properly.
698 --- 1.3.28 2012/04/04
700 New class, wrbuf, that wraps YAZ' WRBUF.
702 --- 1.3.27 2012/03/30
704 Metaproxy daemon is now running as user "metaproxy". This user is
705 managed by package maintainer scripts. The user information is stored
706 in /etc/metaproxy/metaproxy.user .
708 --- 1.3.26 2012/03/20
710 New filter, sort, that allows sorting of XML records via Z39.50
713 Filter record_transform: USEMarcon support. For example:
714 <retrieval syntax="usmarc">
715 <backend syntax="unimarc" name="F">
716 <usemarcon stage1="/etc/usemarcon/uni2us/uni2us.ini"/>
720 Filter multi: empty route pattern uses route as default.
722 <target route="z3950.indexdata.com">z3950.indexdata.com</route>
723 may use the shorter notation
724 <target route="z3950.indexdata.com"/>
726 Filter query_rewrite: use config path to locate XSLT.
728 Filter frontend_net: log statistics.
729 If a custom message element in frontend_net configuration it makes
730 the frontend_net filter produce a log entry whenever an operation
731 is completed. The log is always written using yaz_log with the
732 custom message given, the package ID (session ID) , the time
733 the operation has been active (end-to-end) , the threads currently
734 active/total and the size of the request input/output queues.
736 query_rewrite: charset conversion of query terms.
737 This is an optional feature. Enabled by element <charset> in
738 configuration with attribute 'from' and 'to' that specifies
739 from/to encodings. The default 'from' encoding is UTF-8.
741 Filter record_transform: honor piggyback searches.
743 Filter zoom: re-connect when database is reused.
744 Re-connect is necessary if a connection is lost or a timeout occurs.
745 If not, we'll be seeing zero hits, when we shouldn't.
747 --- 1.3.25 2012/02/29
749 zoom: Change scheme for dealing with content proxy URLs. The module
750 now has its own common XSL transform that is enabled by record_xsl
751 attribute in the configuration. This XSL gets parameter cproxyhost
752 that holds the host for the content proxy session . The genearted-url
753 is created only if urlRecipe is enabled. In previous version default
754 value of urlRecipe was ${md-electronic-url}; it is now empty and
755 disabled by default. Also generated-url no longer includes the content
756 proxy host. Content proxying URLs is supposed to the handle in the record_xsl
759 zoom: new setting timeout that specifies timeout for outgoing Z39.50/SRU
760 connections. Default value is 40 (seconds).
762 zoom: tune CCL to Z39.50 diagnostics mapping. Throw Bib-1: 108
763 "Malformed query" for syntax errors and related ones; throw
764 Bib-1: 3 "Unsupported search" for everything else. Details from
765 the CCL parser is provided as additional-info.
767 multi: new setting hideerrors that makes multi only relay diagnostics
768 to a client if all backends fail.
770 --- 1.3.24 2012/02/23
772 zoom: empty ccl_map field-mappings disables CCL map.
774 zoom: fix Explain search that could return error if session was
777 --- 1.3.23 2012/02/10
779 zoom: returns Explain records for database IR-Explain---1. The
780 target profile records are converted to Explain records via XSLT.
782 session_shared: make error recovery configurable. Whether a search
783 is restarted on errors or not, is configurable by attribute "restart"
784 in element "resultset" in configuration.
786 session_shared: only relay init for first request. session_shared, for
787 each backend class, now only relays first init request (rather than all).
788 The module only needs to save init response info once. This avoids the
789 need to check for session max.
791 --- 1.3.22 2012/02/02
793 zoom: fix memory leaks.
795 session_shared: maximum number of sessons is configurable. Default
796 value is 100. Result-sets for backends without named result sets are
797 only re-used if databases is identical for a search. This is under the
798 assumption that performance may suffer for those backends when
799 changing the database for each search.
801 multi: combines diagnostics from all backends. All diagnostics from
802 backends are combined into multiple non-surrogate diagnostics; rather
803 than just one diagnostic from first backend.
805 --- 1.3.21 2011/12/27
807 zoom: relay realm to cproxy parameter file.
809 Configuration: Allow filter collection element inside route. This
810 makes it possible to include multiple filters at once.
812 zoom: nocproxy also disables urlRecipe.
814 --- 1.3.20 2011/12/21
816 zoom: return diagnostic if CQL sortby conv fails. Diagnostic Bib-1 214
817 "Illegal sort relation" is returned. Gets translated to SRU diagnostic
818 90: "Unsupported direction value".
820 zoom: honor database argument nocproxy. This disables creating a content
821 connector session (for non-CF targets, usually) and also relays nocproxy
822 as database argument to a CF target.
824 --- 1.3.19 2011/12/16
826 zoom: Multiple proxy hosts may be given for proxy rich database
827 parameter. List is comma separated.
829 http_file: decodes URI paths properly. Does not return 404: not found
830 if no prefix are matches. Instead packages are passed on.
832 --- 1.3.18 2011/12/08
834 zoom: content-{user,password,proxy} are passed on to content proxy
835 system and takes precedence over user,password,proxy .
837 sru_z3950: SRU extra argument x-log-enable=1 enables a search response
838 with a log element including log material from children filters. At
839 this point, only the zoom filter uses this log facility. It will
840 eventually be used by other filters as well. In particular it might be
841 useful for this feature to track all filters in used during a search.
843 zoom: for x-log-enable=1, APDUs sent by ZOOM C, records as received
844 and queries as they are manipulated are logged.
846 zoom: extend addinfo with native diagnostics. Diagnostics as received
847 by ZOOM C are put into addinfo - including ZOOM, HTTP, SRU and Bib-1
848 diagnostics. This indicates both a backend diagnostic and the original
851 zoom: default urlRecipe value is ${md-electronic-url}
853 zoom: target profile setting sruVersion is recognized.
855 --- 1.3.17 2011/11/17
857 zoom: log target profile record fetched (AKA Torus).
859 --- 1.3.16 2011/11/17
861 Change target profile parameter CfSubDb to CfSubDB.
863 --- 1.3.15 2011/11/12
865 zoom: bug fix: realm was relayed to CF targets by mistake (realm only
866 makes sense to the zoom module itself).
868 --- 1.3.14 2011/11/11
870 zoom: realm may be given as part of database.
872 --- 1.3.13 2011/10/26
874 Fix Origin class assigment method; was removd by mistake in 1.3.12.
876 --- 1.3.12 2011/10/26
878 zoom: database args x-name=value are passed through to backend database.
880 SRU filter: user may specify session ID that is passed to log entries
881 that follows. It is specified by using x-session-id in the SRU arguments.
883 zoom: fix null pointer reference which would occur for bad url parameter
884 inside "torus" or if url was not given.
886 --- 1.3.11 2011/09/09
887 Fix bug in filter session_shared where sessions would not expire
888 properly (session ttl). This in turn could make the target close the
889 connection before expected and session_shared would return diagnostic
890 2: system temporarily available.
892 --- 1.3.10 2011/09/09
894 zoom: new target profile setting: sortmap_field. If sortmap_field is given
895 the field is mapped to the value for the sortmap. Values not matching
896 sortmap_field are passed verbatim.
898 zoom: new target profile setting: sortStrategy. One of: "z3950", "type7",
899 "cql", "sru11" or "embed". The "embed" chooses type-7 or CQL sortby
900 depending on whether RPN or CQL is actually sent to the target.
904 zoom: urlRecipe result is stored in <pz:metadata type="generated-url">.
906 zoom: For content proxy authentication is stored in param name
907 "auth", instead of "authentication".
911 zoom: relay schema in SRU mode. Previously recordSchema was not affected
916 zoom: new target profile element literalTransform that holds XSLT
917 (encoded as string) for target. Only if present and non-zero length it is
918 considered present. This takes precedence over transform.
920 Don't rely on trang anymore for Git checkout builds. Configuration in etc
921 will only be properly validated if trang is available. From now on only
922 relax NC files are bundled with the source dist.
924 Updates to check for Boost unit test (autoconf stuff). On MacOSX this
925 component was not detected when it should be.
929 z3950_client: mark non-surrogate diagnostics from backend.
931 zoom: a proxy may be specified for HTTP fetch of target profiles.
935 Honor piggyback. Makes some SRU targets behave that insist on
936 maximumRecords > 0, but also increases performance.
940 Fix dlpath in installed metaproxy.xml for RPM/Deb package. The
941 file was not update for libdir/metaproxy4 in version 1.3.2.
945 Change location of Metaproxy modules from libdir/metaproxy to
946 libdir/metaproxy4. Directory libdir/metaproxy is also owned by
947 libmetaproxy3 and, thus, should not be used by libmetaproxy4.
949 New facility to dump APDUs from zoom filter. Enabled by
950 <log apdu="true"/> in the zoom filter configuation.
952 zoom filter bug fix: SRU diagnostics received from backend was
953 not properly converted to Bib-1 diagnostics.
955 Package metaproxy depends on libmetaproxy4, same version.
959 zoom: fix a bug WRT passing authentication parameters to backends.
963 Fixes for windows Makefile.
965 --- 1.2.10 2011/07/25
967 Change major version of metaproxy library from 3 to 4. This in turn
968 makes new package names for Debian and RPM.
972 zoom: enable marc-8 encoding by default for usmarc and opac (in pz2
975 zoom: configurable element sets for record transforms.
977 zoom: the target profile based transform is specified by element_transform
978 in element torus of of the ZOOM filter configuration ; default value
979 is "pz2". Target profile based retrieval is specified by element_raw
980 in configuration. It will perform same steps, but omit the XSL transform.
981 Default value is "raw".
983 zoom: element set is omitted if not set in profile. But only if pz2
984 transform is in effect. Previously the default element set was to "F".
986 zoom: For non-CF targets database arguments are parsed. User may supply
987 db,user=myuser&password=mypass for non-CF targets. These values override
988 what's given the authentication from the target profile.
990 session_shared: fix reference to freed memory. Would occur if a search
991 response had non-surrogate diagnostics.
995 Route may be given for each port in frontend_net.
999 Documentation for zoom filter. Local target profiles may be specified.
1001 Fixes for zoom filter.
1003 --- 1.2.6 2011/06/15
1005 First version with zoom filter.
1007 --- 1.2.5 2011/05/06
1009 Filter z3950_client may be configured to always send a close APDU
1010 to backend target when connection/session is closed. This will only
1011 happen if close APDU is not already sent. Enabled by configuration
1012 for z3950_client (force_close).
1014 Filter virt_db and multi: relay close APDU.
1016 Filter virt_db and multi: relay init size parameters
1017 preferredMessageSize and maximumRecordSize.
1019 Filter sru_z3950: increase init sz parameters from 1MB to 10 MB.
1021 --- 1.2.4 2011/01/27
1023 RPM package for Metaproxy works for both SLES11 and Centos 5.5.
1025 metaproxy-config: exec_prefix, libdir, includedir. Use these variables
1026 as determined by configure.
1028 RPM: Release includes 'indexdata' name. Use indexdata in release name so
1029 this package can be distinguished from other vendors.
1031 --- 1.2.3 2010/10/04
1033 Fix filter multi: relay idAuthentication parameters.
1035 --- 1.2.2 2010/09/15
1037 Add metaproxy-config for returning compiler flags, libraries.
1039 --- 1.2.1 2010/08/18
1041 Fix --with-boost=PREFIX .
1043 --- 1.2.0 2010/07/09
1045 session_shared: fix use of maintenance thread.
1047 Introduce 'start' method for filters and routers. It gets called after
1048 configure and after fork, but before processing. This changes API -
1049 from libmetaproxy2 to libmetaproxy3.
1051 --- 1.1.7 2010/06/30
1053 session_shared: ensure backend session is closed if init rejected
1056 z3950_client: fix NULL ptr reference that could occur if two clients
1057 connected concurrently and if max-sockets was in effect.
1059 --- 1.1.6 2010/06/21
1061 Fix bug 3497 - Metaproxy unstable while stopping.
1063 Fix bug 3495 - SEGV in SRU filter.
1065 --- 1.1.5 2010/06/15
1067 Filter multi throws diagnostic 'Present Out of Range' when
1068 appropriate - rather than returning 0 records.
1070 Filter virt_db: fix bad result reuse. Could happen if a result
1071 was overriden and a backend did not supported named result sets.
1073 --- 1.1.4 2010/05/11
1075 Filter log: category access logs diagnostics even if searchStatus
1076 or presentStatus is 'success'.
1078 --- 1.1.3 2010/04/21
1080 The SRU to Z39.50 filter does repeated Z39.50 present requests
1081 to fetch all records. Needed when a Z39.50 server returns partial
1082 results (due to message size limits).
1084 --- 1.1.2 2010/03/18
1086 Metaproxy now kills all child processes that are spawned by
1087 modules (in case of fork, exec).
1089 --- 1.1.1 2010/01/28
1091 Debian package now installs /etc/metaproxy/metaproxy.xml which
1092 includes all XML files /etc/metaproxy/filters-enabled .
1093 The include facility uses YAZ' yaz_xml_include_simple (YAZ 4.0.1).
1095 --- 1.1.0 2010/01/20
1097 Package based on YAZ version 4 and YAZ++ 1.2.0. It now includes a
1098 development package to facilitate 3rd party Metaproxy modules.
1100 --- 1.0.23 2010/01/04
1102 Filter virt_db: Close backend filter session when Init rejected is received
1103 from it (in which case it's not really closed yet). This will ensure we don't
1104 run out of resources such as FDs in this case.
1106 sru_z3950 filter: Accept any database (including those not listed).
1108 --- 1.0.22 2009/12/03
1110 Prepare for 64-bit YAZ. yazproxy will still work with YAZ++ 1.1.4 or
1111 later which means YAZ 3.0.47 or later.
1113 --- 1.0.20 2009/11/19
1115 For filter virt_db, the database is a glob pattern and the virtual
1116 database sections are consulted in the order given.
1118 --- 1.0.19 2009/07/08
1120 For filter multi, the target (for routing) may be given as a glob-pattern.
1122 More documentation for filters virt_db and multi.
1124 Update schema to allow for no database in sru_z3950 filter.
1126 --- 1.0.18 2009/06/30
1128 Added limit filter to put sleep (penalty) for heavy use.
1130 Filter frontend_net may be configured to limit the number of new connections
1131 from same IP to some value (connect-max).
1133 Fixed the load_balance filter.
1135 --- 1.0.17 2009/06/16
1137 Fix path for metaproxy executable for Debian init.d script.
1139 --- 1.0.16 2009/06/10
1141 SRU to Z39.50 filter honors x-username and x-password. If only
1142 x-username is given that translates to open authentication (Z39.50v2). If
1143 both x-username and x-password is present that translates to idPass
1144 authentication (Z39.50v3).
1146 New facility to change current working directory (-w).
1148 Update to upstream skeleton of init.d script. Should fix bug #2619.
1150 Filter session_shared now caches records (used to only cache connections
1153 Filter session_shared now invalidates a Z39.50 session if a server
1154 returns -1 hits. This facility was also part of yazproxy and gets around
1155 a bug in Voyager-based Z39.50 servers.
1157 --- 1.0.15 2008/11/18
1159 Fixed reference counting bug in Z39.50 client module (could cause SEGV).
1161 --- 1.0.14 2008/06/09
1163 Fixed the value of SRU record schema in searchRetrieve response. It was set
1164 to a fixed value of "dc" before.
1166 Serialize identical SRU requests. This is useful if HTTP client software
1167 fires identical requests against metaproxy.
1169 Allow Z39.50 target to be specified for SRU requests by using SRU extra
1170 parameter x-target. Allows SRU to contact arbitrary Z39.50 targets and
1171 avoid static configuration. This facility is handled by the sru_z3950 module
1172 and the z3950_client module.
1174 Allow maximum number of sockets to be used for a Z39.50 client by the
1175 use of SRU extra parameter x-max-sockets. This facility is handled by the
1176 sru_z3950 module and the z3950_client module.
1178 --- 1.0.13.1 2008/02/29
1180 Simplified check for Boost libraries.
1182 --- 1.0.13 2008/02/29
1184 First Debian package.
1186 The sru_z9350 filter now recognizes SRU parameter z-target as being
1187 a ZURL of the form host/database .
1189 Mergetype may be specified for filter 'multi'.
1191 --- 1.0.12 2007/09/19
1193 Fixed problem in Makefile WRT library specifictions. This could produce
1194 linker errors (when they should not happen).
1196 Fixed bug #1341: MetaProxy returning different results. Problem was that
1197 fix-up of record database did not normalize the database name.
1199 Documentation updates for Windows compilation.
1201 --- 1.0.11 2007/06/14
1203 Fixed problem with logfile being truncated.
1205 --- 1.0.10 2007/05/23
1207 Fixed bug #1136: Access rights not enforced.
1209 Extension for log module. The log category 'access' logs more details.
1210 New category 'user-access' added which is simlar to 'access' but adds
1211 the Z39.50 user as for all entries in a session.
1215 Added support for configurable default/force target/vhost for module Z39.50
1218 --- 1.0.8 2007/01/25
1220 Implemented filter, session_shared, which optimizes usage of Z39.50
1221 sessions and result sets.
1223 New filter, record_transform, which converts MARC/XML records.
1225 New filter, sru_z3950, which converts SRU to Z39.50 packages.
1227 New filter, load_balance, in development.
1229 New filter, zeerex_xplain.
1231 XML framework for config files started.
1233 Master RelaxNG Compact schema's are found in xml/schema/*.rnc,
1234 RelaxNG XML schemas and XML Schema's are generated from RNC syntax.
1235 XML config files are checked against RNG and XML Schema's.
1237 XSLT transformation framework added in xml/xslt/*.xsl, consisting mainly of
1238 LOC Marc21 stylesheets found at http://www.loc.gov/marcxml/xslt.
1239 Added stylesheet explain2cqlpqftxt.xsl which transforms a standard SRU ZeeReX
1240 explain record to YAZ CQL-to-PQF text config file.
1242 --- 1.0.7 2006/11/07
1244 Added 'timeout' setting for filter frontend_net which specifies the number
1245 of seconds a session is idle before it is closed. Default timeout is
1248 --- 1.0.6 2006/07/07
1250 Database name in records returned set for virt_db/multi filters.
1252 Filter session_shared now functional.
1254 Log filter can be configured to write to a given file using 'filename'
1255 element. Also information category can be specified with 'category'. If
1256 filename is omitted, the log filter writes to stdout. See etc/config5.xml
1259 --- 1.0.5 2006/05/16
1261 Fixed compilation on Windows.
1263 --- 1.0.4 2006/05/16
1265 Added documentation for the hidenavailable option for the multi filter.
1267 --- 1.0.3 2006/05/16
1269 Fixed bug #573: Hide errors for individual servers. If the element
1270 'hideunavailable' is given in the configuration, individual servers
1271 being unavailable are hidden (unless all are unavailable).
1273 Fixed bug #574: Database names are recognised case-sensitively.
1275 Fixed bug #567: Fix up database name in Name-Plus-Record.
1277 Fixed bug #568: Update win/makefile for VS 2005.
1279 Fixed bug #569: Some options throws unknown exception.
1281 --- 1.0.2 2006/04/28
1283 More information about virtual hosts. The 'etc' directory is part of the
1286 --- 1.0.1 2006/04/27
1288 Build instructions for Windows. NMake makefile part of distribution tar.
1290 --- 1.0.0 2006/04/24
1294 Filters functional: auth_simple, backend_test, frontend_net, http_file,
1295 log, multi, query_rewrite, template, virt_db, z3950_client.
1297 Filters in development: session_shared.
1299 Pseudo-filters: template, dl