Athanasius
44b5a1d789
docs/schemas: slight wording tweak about live schemas
2022-01-09 14:57:05 +00:00
Athanasius
36de2145d7
docs: schemas: General improvement pass to aid new developers
...
* Make lots of 'obvious' things explicit, e.g. HTTP 1.1, not HTTP/2, and
HTTPS not plain HTTP.
* The live service should always be using the schemas as present in the
live branch, not master or another branch.
* A 'good' message will receive 'HTTP 200' status *and* a body of `OK`.
2022-01-09 14:52:41 +00:00
Athanasius
424fa72557
setup.py: Add 'enforce correct branch' TODO
2022-01-09 13:19:40 +00:00
Athanasius
1bb8a37c34
scripts: Add eddn-report-log-errors
...
This looks at gateway.log files for any 'ERROR' lines. The output
should be any lines representing an error that hasn't yet been reported
to the softwareName's developer.
NB: Absolutely relies on the developer changing the softwareVersion
after applying a fix.
2022-01-09 13:09:04 +00:00
Athanasius
10d70bfe77
Gateway: Properly report 'not compressed, badly form-encoded' to uploaders
...
* This code worked if the request was *properly* form-encoded, with a
'data' key whose value was a valid message.
* It failed to detect where the request was form-encoded, with without a
'data' key. It would just assume 'not form-encoded' in that case, then
fail later on JSON parsing.
Thus, re-use the `urlparse.parse_qs()` check for form-encoded format.
This passes:
1. Properly, `data` key, form-encoded with valid value is fully JSON
parsed, schema checked and accepted.
2. *NOT* compressed *or* form-encoded valid message is properly parsed
and accepted.
2. Uncompressed, form-encoded, but no `data` key correctly returns the
same error status and body as the compressed+form-encoded+no data key
path.
2022-01-07 16:45:37 +00:00
Athanasius
872af7f594
Gateway: Properly report 'badly form encoded' to uploaders
...
This currently only applies if the data was also, validly, compressed.
2022-01-07 16:32:10 +00:00
Athanasius
10b12cf74b
Gateway: Properly report zlib.decompress() errors to uploaders
...
This also adds some debug/error logging to the code path.
2022-01-07 16:04:00 +00:00
Athanasius
207068f156
docs: Cite issue on "some error bodies don't have FAIL: prefix"
2022-01-07 15:37:07 +00:00
Athanasius
d2c4c98c2b
docs: Possible server responses, and handling them
2022-01-07 15:20:05 +00:00
Athanasius
0bf8fc3abb
Merge pull request #159 from EDCD/enhancement/158/request-size-limit
...
Address `bottle` default request size rejecting some messages
2022-01-07 10:41:21 +00:00
Athanasius
1134a6c9b4
Gateway: Only log first 512 characters of invalid JSON
...
Don't want to spam the logs with up to 1MiB per bad message.
2022-01-06 17:39:01 +00:00
Athanasius
9f219da6a6
Gateway: Expand on logging for interpretation of errors
...
This includes logging the *full* (uncompressed) message if it fails to
parse as JSON.
2022-01-06 17:36:39 +00:00
Athanasius
1371f71217
Gateway: Set up proper logger formatting
...
For some reason the milliseconds portion of the %S timestamp is using a
comma for decimals separator, despite 'locale' saying we're set to (US)
English. /tableflip
2022-01-06 14:06:59 +00:00
Athanasius
377bdd3833
Gateway: Add logging per Accepted request
...
Actually some logging was already there, just the logger had never been
set up properly, but then I decided to make the format of this message
more useful.
2022-01-06 13:54:33 +00:00
Athanasius
0e80c76cb5
Gateway: Set bottle request limit to 1MiB
2022-01-06 13:07:53 +00:00
Athanasius
fa118d0183
schemas/codexentry: Clarify that what unset status_body_name means
2021-12-21 09:37:08 +00:00
Athanasius
f8c1ce7a3e
Script for testing schemas
2021-11-07 16:22:14 +00:00
Athanasius
229ae1556a
Merge branch 'develop' of github.com:EDCD/EDDN into develop
2021-11-04 17:15:17 +00:00
Athanasius
b78fcf349f
Merge branch 'develop'
2021-11-04 11:26:35 +00:00
Athanasius
ac0a872d30
Merge pull request #151 from EDCD/enhancement/document-all-schemas
...
Document all of the schemas in their own README
2021-11-04 11:26:04 +00:00
Athanasius
d6a43c04d9
schemas: README: Add 'Receiving messages' section
2021-11-04 11:14:47 +00:00
Athanasius
1b11519ee7
schemas: READMEs: Centralise "detecting CAPI lag" advice
2021-11-04 11:03:51 +00:00
Athanasius
e0c1ac85fd
schemas: fssdiscoveryscan: README: Don't over-state elisions
2021-11-02 11:32:54 +00:00
Athanasius
6704e1a957
schemas: commodity: README: Allow LoadGame horizons flag for CAPI data
2021-11-02 11:30:25 +00:00
Athanasius
5b05e4879f
schemas: commodity: README: Call out statusFlags
2021-11-02 11:24:37 +00:00
Athanasius
6e81afc98c
schemas: blackmarket: README: Count doesn't need to be elided
2021-11-02 11:20:43 +00:00
Athanasius
53acd5ed1e
schemas: blackmarket: README: Correct referenced Journal event
2021-11-02 11:20:09 +00:00
Athanasius
aebf3ac479
schemas: README: Remove final things now mentioned in specific READMEs
2021-11-01 16:02:12 +00:00
Athanasius
57e8b9af4b
schemas: README: shipyard unavailable_list already noted in its README
2021-11-01 15:59:38 +00:00
Athanasius
a32f047b7f
schemas: README: outfitting-specific elisions in that file already
2021-11-01 15:58:35 +00:00
Athanasius
b9231cef12
schemas: READMEs: Move commodity-specific elisions into its file
2021-11-01 15:58:00 +00:00
Athanasius
339abce9e4
schemas: READMES: Consistent horizons/odyssey language
2021-11-01 15:52:56 +00:00
Athanasius
3d023bf280
schemas: shipyard: README: Initial version
2021-11-01 15:46:08 +00:00
Athanasius
e12ebee9f8
schemas: scanbarycentre: README: Initial version
2021-11-01 15:15:03 +00:00
Athanasius
a32d6e2ea3
schemas: outfitting: README: Initial version
2021-11-01 15:11:15 +00:00
Athanasius
6c1d8cff92
schemas: navroute: README: Initial version
2021-11-01 14:58:54 +00:00
Athanasius
67e77136ff
schemas: navbeaconscan: README: Initial version
2021-11-01 14:54:10 +00:00
Athanasius
fd567e69aa
schemas: journal: README: Now complete, in the generic sense
...
Ideally all the events covered here need splitting into their own
schemas, but for the time being this documentation should suffice.
2021-11-01 14:44:28 +00:00
Athanasius
635d7c2693
schemas: README: Note about key names being originally CAPI based
2021-11-01 14:31:59 +00:00
Athanasius
fc7443b282
schemas: fssdiscoveryscan: README: Initial version
2021-10-29 15:09:30 +01:00
Athanasius
d781160e6e
schemas: commodity: README: _Localised keys correction
2021-10-29 15:05:28 +01:00
Athanasius
8178e61b00
schemas: commodity: README: Correct top-level header
2021-10-29 15:01:02 +01:00
Athanasius
8e03a82536
schemas: commodity: README: Document use of CAPI data
2021-10-29 14:27:40 +01:00
Athanasius
68160fcb8d
schemas: commodity: Initial README
2021-10-29 14:10:49 +01:00
Athanasius
ed30aa4f01
schemas: blackmarket: No, that's no an additional timestamp
2021-10-29 13:54:39 +01:00
Athanasius
b35b934d8c
schemas: blackmarket: README
...
Note that it turns out this is deprecated in favour of the `prohibited`
array defined in the `commodity` schema, and has been that way since
September 2017.
2021-10-29 13:42:43 +01:00
Athanasius
254e3f0361
Merge branch 'develop'
2021-10-27 11:47:02 +00:00
Athanasius
f984ce4c79
schemas: Correct 'id' in navbeaconscan-v1.0.json
...
It still had 'fssdiscoveryscan' in there, presumably from a copying.
2021-10-27 11:46:04 +00:00
Athanasius
652c50ab06
Merge branch 'develop'
2021-10-27 11:43:44 +00:00
Athanasius
b5b5c70559
Merge pull request #149 from EDCD/fix/codexentry-empty-nearestdestination
...
schemas: codexentry needs to allow empty NearestDestination
2021-10-27 12:40:12 +01:00
