metaproxy-moved-to-github.git
11 years agoSimplify http rewrite test a bit
Adam Dickmeiss [Wed, 3 Jul 2013 12:12:16 +0000 (14:12 +0200)]
Simplify http rewrite test a bit

11 years agohttp_rewrite: content areas
Adam Dickmeiss [Wed, 3 Jul 2013 12:03:09 +0000 (14:03 +0200)]
http_rewrite: content areas

One for type=html and one for type=headers.

11 years agoHTML parser: elements starts with [A-Za-z]
Adam Dickmeiss [Tue, 2 Jul 2013 13:41:06 +0000 (15:41 +0200)]
HTML parser: elements starts with [A-Za-z]

11 years agoSkip start anchor for text sections entirely
Adam Dickmeiss [Tue, 2 Jul 2013 12:27:42 +0000 (14:27 +0200)]
Skip start anchor for text sections entirely

11 years agohttp_rewrite: fix start anchor (^) match
Adam Dickmeiss [Tue, 2 Jul 2013 11:24:34 +0000 (13:24 +0200)]
http_rewrite: fix start anchor (^) match

11 years agohttp_client: disables HTTP redirect by default
Adam Dickmeiss [Tue, 2 Jul 2013 09:03:08 +0000 (11:03 +0200)]
http_client: disables HTTP redirect by default

It can be configured with max-redirects in configuration.

11 years agofilter_http_rewrite: don't crash if "Host" header is missing
Adam Dickmeiss [Mon, 1 Jul 2013 14:20:54 +0000 (16:20 +0200)]
filter_http_rewrite: don't crash if "Host" header is missing

11 years agoTesting for all Replace rules in use
Adam Dickmeiss [Mon, 1 Jul 2013 13:46:43 +0000 (15:46 +0200)]
Testing for all Replace rules in use

11 years agoUse all Replaces from/to in each buffer
Adam Dickmeiss [Mon, 1 Jul 2013 13:46:01 +0000 (15:46 +0200)]
Use all Replaces from/to in each buffer

11 years agoboost::smatch part of Replace object too
Adam Dickmeiss [Mon, 1 Jul 2013 13:23:23 +0000 (15:23 +0200)]
boost::smatch part of Replace object too

11 years agoRefactor: compiled regex part of Replace object
Adam Dickmeiss [Mon, 1 Jul 2013 13:12:44 +0000 (15:12 +0200)]
Refactor: compiled regex part of Replace object

11 years agoRemove trailing whitespace
Adam Dickmeiss [Mon, 1 Jul 2013 12:05:04 +0000 (14:05 +0200)]
Remove trailing whitespace

11 years agoOption attribute values for HTML parser
Adam Dickmeiss [Mon, 1 Jul 2013 12:04:31 +0000 (14:04 +0200)]
Option attribute values for HTML parser

11 years agoHTMLParser more forgiving with bad attributes
Adam Dickmeiss [Thu, 27 Jun 2013 14:40:50 +0000 (16:40 +0200)]
HTMLParser more forgiving with bad attributes

The idea is not to fix, but at least passthru as text.

11 years agoHTMLParserEvent, attributes takes quoting sep
Adam Dickmeiss [Thu, 27 Jun 2013 12:33:01 +0000 (14:33 +0200)]
HTMLParserEvent, attributes takes quoting sep

as argument, so that quoting (if any) is preserved.

11 years agoEvent.text for whitespace in <x/ > tags
Adam Dickmeiss [Thu, 27 Jun 2013 12:23:02 +0000 (14:23 +0200)]
Event.text for whitespace in <x/ > tags

11 years agoSet vars in replacement also if empty
Adam Dickmeiss [Thu, 27 Jun 2013 11:32:08 +0000 (13:32 +0200)]
Set vars in replacement also if empty

11 years agoReformat a bit
Adam Dickmeiss [Thu, 27 Jun 2013 11:31:46 +0000 (13:31 +0200)]
Reformat a bit

11 years agoStack up attr="#text" things
Adam Dickmeiss [Thu, 27 Jun 2013 10:28:25 +0000 (12:28 +0200)]
Stack up attr="#text" things

11 years agoOnly do CDATA for attr="#text", verbose flag
Adam Dickmeiss [Thu, 27 Jun 2013 09:50:23 +0000 (11:50 +0200)]
Only do CDATA for attr="#text", verbose flag

11 years agoMore tests for html_parser
Adam Dickmeiss [Thu, 27 Jun 2013 09:50:04 +0000 (11:50 +0200)]
More tests for html_parser

11 years agoHTMLParser, verbose setting
Adam Dickmeiss [Thu, 27 Jun 2013 09:49:45 +0000 (11:49 +0200)]
HTMLParser, verbose setting

11 years agoRevise HTML parser; keep spelling
Adam Dickmeiss [Wed, 26 Jun 2013 14:58:10 +0000 (16:58 +0200)]
Revise HTML parser; keep spelling

Fixes for DTD/PIs handling. 0-copy for tags and attributes (no
limit). No debug output, unless verbose is set for HTMLParser.

11 years agoNo dupe function (leaks)
Adam Dickmeiss [Wed, 26 Jun 2013 12:33:01 +0000 (14:33 +0200)]
No dupe function (leaks)

11 years agoReformat
Adam Dickmeiss [Wed, 26 Jun 2013 12:29:58 +0000 (14:29 +0200)]
Reformat

11 years agoReformat of HTMLparser source
Adam Dickmeiss [Wed, 26 Jun 2013 12:28:38 +0000 (14:28 +0200)]
Reformat of HTMLparser source

11 years agohttp_rewrite using HTML parser
Adam Dickmeiss [Wed, 26 Jun 2013 12:19:55 +0000 (14:19 +0200)]
http_rewrite using HTML parser

11 years agoDeciding rules for within
Adam Dickmeiss [Tue, 25 Jun 2013 14:47:02 +0000 (16:47 +0200)]
Deciding rules for within

Not really tested yet.

11 years agoRemove unused code, fix printing
Adam Dickmeiss [Tue, 25 Jun 2013 14:46:53 +0000 (16:46 +0200)]
Remove unused code, fix printing

11 years agoRefactor a bit
Adam Dickmeiss [Tue, 25 Jun 2013 13:21:15 +0000 (15:21 +0200)]
Refactor a bit

11 years agohttp_rewrite: HTMLParser boilerplate
Adam Dickmeiss [Fri, 21 Jun 2013 12:51:07 +0000 (14:51 +0200)]
http_rewrite: HTMLParser boilerplate

11 years agoRemove redundant include
Adam Dickmeiss [Fri, 21 Jun 2013 12:30:09 +0000 (14:30 +0200)]
Remove redundant include

11 years agohttp_rewrite: rename Section -> Phase
Adam Dickmeiss [Fri, 21 Jun 2013 12:28:56 +0000 (14:28 +0200)]
http_rewrite: rename Section -> Phase

11 years agohttp_rewrite: parsing of new configuration
Adam Dickmeiss [Thu, 20 Jun 2013 13:12:13 +0000 (15:12 +0200)]
http_rewrite: parsing of new configuration

but at this point, still no HTML parsing and only first
"within" rule is being executed everywhere.

11 years agoAdd http rewrite objects for windows
Adam Dickmeiss [Wed, 19 Jun 2013 13:06:44 +0000 (15:06 +0200)]
Add http rewrite objects for windows

11 years agohttp_file: raw mode functional
Adam Dickmeiss [Wed, 19 Jun 2013 10:47:12 +0000 (12:47 +0200)]
http_file: raw mode functional

and schema updated accordingly

11 years agoMerge branch 'master' into http_file_raw
Adam Dickmeiss [Wed, 19 Jun 2013 09:44:09 +0000 (11:44 +0200)]
Merge branch 'master' into http_file_raw

11 years agosort list of filters
Adam Dickmeiss [Wed, 19 Jun 2013 09:42:50 +0000 (11:42 +0200)]
sort list of filters

11 years agohttp_rewrite: Avoid ?<group> regex'es.
Adam Dickmeiss [Wed, 19 Jun 2013 09:26:21 +0000 (11:26 +0200)]
http_rewrite: Avoid ?<group> regex'es.

They don't work in Boost 1.33 (rather old).

11 years agoReformat: remove trailing whitespace
Adam Dickmeiss [Wed, 19 Jun 2013 08:59:38 +0000 (08:59 +0000)]
Reformat: remove trailing whitespace

11 years agostring offsets of type size_t
Adam Dickmeiss [Wed, 19 Jun 2013 08:58:50 +0000 (08:58 +0000)]
string offsets of type size_t

11 years agoFix warning
Adam Dickmeiss [Wed, 19 Jun 2013 08:47:33 +0000 (08:47 +0000)]
Fix warning

11 years agoMerge branch 'master' into rewrite-filter
Adam Dickmeiss [Wed, 19 Jun 2013 08:26:59 +0000 (10:26 +0200)]
Merge branch 'master' into rewrite-filter

11 years agofilter sort relays RecordComposition
Adam Dickmeiss [Mon, 17 Jun 2013 12:49:22 +0000 (14:49 +0200)]
filter sort relays RecordComposition

including elementSet in use for search.

11 years agoAdd util piggyback_to_RecordComposition
Adam Dickmeiss [Mon, 17 Jun 2013 12:48:51 +0000 (14:48 +0200)]
Add util piggyback_to_RecordComposition

11 years agoRemove useless comment in retrievalinfo schema
Adam Dickmeiss [Fri, 14 Jun 2013 08:42:02 +0000 (10:42 +0200)]
Remove useless comment in retrievalinfo schema

11 years agoFix src/Makefile.am after merge
Heikki Levanto [Thu, 13 Jun 2013 10:57:45 +0000 (12:57 +0200)]
Fix src/Makefile.am after merge

11 years agoMerge remote-tracking branch 'origin/master' into rewrite-filter
Heikki Levanto [Thu, 13 Jun 2013 10:16:03 +0000 (12:16 +0200)]
Merge remote-tracking branch 'origin/master' into rewrite-filter

11 years agoBuild-in filters part of libmetaproxy so again
Adam Dickmeiss [Thu, 13 Jun 2013 09:57:17 +0000 (11:57 +0200)]
Build-in filters part of libmetaproxy so again

And registration takes place in FactoryStatic . Not really
elegant.

11 years agoVersion 1.3.58 v1.3.58
Adam Dickmeiss [Wed, 12 Jun 2013 19:49:23 +0000 (21:49 +0200)]
Version 1.3.58

11 years agoFix load of filters cql_rpn, sru_z3950
Adam Dickmeiss [Wed, 12 Jun 2013 19:41:57 +0000 (21:41 +0200)]
Fix load of filters cql_rpn, sru_z3950

11 years agoVersion 1.3.57 v1.3.57
Adam Dickmeiss [Wed, 12 Jun 2013 13:44:10 +0000 (15:44 +0200)]
Version 1.3.57

11 years agoNo longer build for Ubuntu natty
Adam Dickmeiss [Wed, 12 Jun 2013 13:41:51 +0000 (15:41 +0200)]
No longer build for Ubuntu natty

11 years agoMerge remote-tracking branch 'origin/master' into rewrite-filter
Heikki Levanto [Wed, 12 Jun 2013 13:31:08 +0000 (15:31 +0200)]
Merge remote-tracking branch 'origin/master' into rewrite-filter

11 years agoMove Factory{Static,Filter} to libmetaproxy
Adam Dickmeiss [Wed, 12 Jun 2013 12:35:14 +0000 (14:35 +0200)]
Move Factory{Static,Filter} to libmetaproxy

It's needed by RouterXML.

11 years agoFactoryStatic: rely on auto load for dl-enabled systems
Adam Dickmeiss [Wed, 12 Jun 2013 12:34:44 +0000 (14:34 +0200)]
FactoryStatic: rely on auto load for dl-enabled systems

We don't need the static registration for those.

11 years agoAdd RouterXML in public API MP-450
Adam Dickmeiss [Wed, 12 Jun 2013 12:08:33 +0000 (14:08 +0200)]
Add RouterXML in public API MP-450

11 years agoRemove FactoryFilter:have_dl_support
Adam Dickmeiss [Wed, 12 Jun 2013 09:39:29 +0000 (11:39 +0200)]
Remove FactoryFilter:have_dl_support

11 years agoRemoved global test setup
Heikki Levanto [Wed, 12 Jun 2013 09:36:52 +0000 (11:36 +0200)]
Removed global test setup

It didn't do anything much, and failed to compile on Centos5

11 years agosru_z3950: separate x-client prefix for each dbargs
Adam Dickmeiss [Tue, 11 Jun 2013 13:20:17 +0000 (15:20 +0200)]
sru_z3950: separate x-client prefix for each dbargs

Eg x-client-user=kurt rather than x-dbargs=user&3Dkurt .

11 years agosru_z3950: honor x-dbargs MP-452
Adam Dickmeiss [Tue, 11 Jun 2013 12:59:52 +0000 (14:59 +0200)]
sru_z3950: honor x-dbargs MP-452

As an alternative to dbargs in path. The x-dbargs argument
is without the comma separator. Value must be encoded in
particular = (%3D).

11 years agohttp_client: honor X-Metaproxy-Proxy MP-451
Adam Dickmeiss [Tue, 11 Jun 2013 11:47:22 +0000 (13:47 +0200)]
http_client: honor X-Metaproxy-Proxy MP-451

And require YAZ 4.2.59 because it has z_HTTP_header_remove.

11 years agoRefactor HTTP rewrite filter and tests
Jakub Skoczen [Mon, 10 Jun 2013 15:28:10 +0000 (17:28 +0200)]
Refactor HTTP rewrite filter and tests

11 years agoMerge remote-tracking branch 'origin/master' into rewrite-filter
Heikki Levanto [Wed, 29 May 2013 11:12:49 +0000 (13:12 +0200)]
Merge remote-tracking branch 'origin/master' into rewrite-filter

Conflicts:
src/Makefile.am

Signed-off-by: Heikki Levanto <heikki@indexdata.dk>

11 years agoAdd test in example module using RouterChain
Adam Dickmeiss [Wed, 29 May 2013 10:45:07 +0000 (12:45 +0200)]
Add test in example module using RouterChain

11 years agorouter_chain part of public API
Adam Dickmeiss [Wed, 29 May 2013 10:34:19 +0000 (12:34 +0200)]
router_chain part of public API

11 years agoVersion 1.3.56 v1.3.56
Adam Dickmeiss [Mon, 27 May 2013 11:15:35 +0000 (13:15 +0200)]
Version 1.3.56

11 years agoUse different port in example
Adam Dickmeiss [Mon, 27 May 2013 11:12:59 +0000 (13:12 +0200)]
Use different port in example

11 years agoInclude config_proxy.xml in dist
Adam Dickmeiss [Mon, 27 May 2013 11:12:04 +0000 (13:12 +0200)]
Include config_proxy.xml in dist

11 years agoMore documentation for http_client
Adam Dickmeiss [Mon, 27 May 2013 11:11:58 +0000 (13:11 +0200)]
More documentation for http_client

11 years agoHTTP proxy example
Adam Dickmeiss [Mon, 27 May 2013 11:00:35 +0000 (13:00 +0200)]
HTTP proxy example

11 years agoUpdate NEWS
Adam Dickmeiss [Mon, 27 May 2013 11:00:28 +0000 (13:00 +0200)]
Update NEWS

11 years agohttp_client: remove Transfer-Encoding from resp MK-445
Adam Dickmeiss [Thu, 16 May 2013 08:13:50 +0000 (10:13 +0200)]
http_client: remove Transfer-Encoding from resp MK-445

The Transfer-Encoding should not be relay'ed back to frontend_net
etc.. This will cause a bad response.

11 years agoFix tstdl linking
Adam Dickmeiss [Wed, 15 May 2013 09:17:08 +0000 (09:17 +0000)]
Fix tstdl linking

11 years agoWork on raw fetch in http_file
Adam Dickmeiss [Wed, 15 May 2013 09:03:36 +0000 (11:03 +0200)]
Work on raw fetch in http_file

11 years agosd_remove: log error msg + addinfo
Adam Dickmeiss [Wed, 15 May 2013 08:53:45 +0000 (10:53 +0200)]
sd_remove: log error msg + addinfo

11 years agoRemove useless examples
Adam Dickmeiss [Wed, 15 May 2013 08:21:50 +0000 (10:21 +0200)]
Remove useless examples

11 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy
Adam Dickmeiss [Wed, 15 May 2013 08:05:23 +0000 (10:05 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy

11 years agoFix linking in shared mode
Adam Dickmeiss [Wed, 15 May 2013 08:04:14 +0000 (10:04 +0200)]
Fix linking in shared mode

The libmetaproxy library is stripped further and contains
only utilities by this.

11 years agoUpdate nmake for present_chunk filter
Adam Dickmeiss [Tue, 14 May 2013 19:34:02 +0000 (21:34 +0200)]
Update nmake for present_chunk filter

11 years agoMerge remote-tracking branch 'origin/mp_434'
Adam Dickmeiss [Tue, 14 May 2013 19:32:50 +0000 (21:32 +0200)]
Merge remote-tracking branch 'origin/mp_434'

Conflicts:
etc/config1.xml
src/Makefile.am

11 years agoUpdate nmake for sd_remove
Adam Dickmeiss [Tue, 14 May 2013 13:40:26 +0000 (15:40 +0200)]
Update nmake for sd_remove

11 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy
Adam Dickmeiss [Tue, 14 May 2013 13:34:17 +0000 (15:34 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy

11 years agoUpdate nmake for new filters
Adam Dickmeiss [Tue, 14 May 2013 13:33:55 +0000 (15:33 +0200)]
Update nmake for new filters

11 years agoNew filter sd_remove
Adam Dickmeiss [Tue, 14 May 2013 13:21:39 +0000 (15:21 +0200)]
New filter sd_remove

which removes surrogate diagnostics.

11 years agoUpdate m4
Adam Dickmeiss [Tue, 14 May 2013 12:21:43 +0000 (14:21 +0200)]
Update m4

11 years agoUse dlsym to load all filters
Adam Dickmeiss [Tue, 14 May 2013 09:17:51 +0000 (11:17 +0200)]
Use dlsym to load all filters

Not on Windows, however, where dlsym is unavailable.

11 years agoAvoid re allocations
Jakub Skoczen [Fri, 10 May 2013 18:28:02 +0000 (20:28 +0200)]
Avoid re allocations

11 years agoMerge branch 'rewrite-filter' of ssh://git.indexdata.com/home/git/pub/metaproxy into...
Jakub Skoczen [Fri, 10 May 2013 14:53:20 +0000 (16:53 +0200)]
Merge branch 'rewrite-filter' of ssh://git.indexdata.com/home/git/pub/metaproxy into rewrite-filter

11 years agoHTML push parser
Jakub Skoczen [Fri, 10 May 2013 14:50:56 +0000 (16:50 +0200)]
HTML push parser

Based on Adam's tclrobot but more aligned with the HTML specs

* all different forms of attrs supported
* whitespaces after tag names allowed
* pi/dtd passthru

also various fixes.

11 years agoFix the test case
Jakub Skoczen [Wed, 8 May 2013 16:02:40 +0000 (18:02 +0200)]
Fix the test case

11 years agoTry to comapte buffers
Jakub Skoczen [Wed, 8 May 2013 14:49:30 +0000 (16:49 +0200)]
Try to comapte buffers

11 years agoMore self-contained test
Jakub Skoczen [Wed, 8 May 2013 14:04:30 +0000 (16:04 +0200)]
More self-contained test

11 years agoSeparate boost system check
Adam Dickmeiss [Wed, 8 May 2013 10:20:30 +0000 (12:20 +0200)]
Separate boost system check

11 years agoMerge remote-tracking branch 'origin/master' into rewrite-filter
Jakub Skoczen [Tue, 7 May 2013 15:25:00 +0000 (17:25 +0200)]
Merge remote-tracking branch 'origin/master' into rewrite-filter

11 years agoAvoid some re-alloc
Jakub Skoczen [Tue, 7 May 2013 15:24:17 +0000 (17:24 +0200)]
Avoid some re-alloc

11 years agoFix multiple match aggregation
Jakub Skoczen [Tue, 7 May 2013 14:45:38 +0000 (16:45 +0200)]
Fix multiple match aggregation

11 years agoFix response rewriting
Jakub Skoczen [Tue, 7 May 2013 13:44:57 +0000 (15:44 +0200)]
Fix response rewriting

11 years agoAllow YAZ log level to be given for metaproxy prog
Adam Dickmeiss [Tue, 7 May 2013 12:46:54 +0000 (14:46 +0200)]
Allow YAZ log level to be given for metaproxy prog

11 years agoUsing log level
Jakub Skoczen [Tue, 7 May 2013 12:43:09 +0000 (14:43 +0200)]
Using log level