wukko
82f3062759
api & web: bump package version to 10.7.5
2025-02-18 18:30:15 +06:00
jj
dba405a6b4
api/facebook: add dispatcher support ( #1115 )
2025-02-18 17:44:25 +06:00
jj
a52aee2bb3
ci: use TEST_IGNORE_SERVICES variable for ignoring services
2025-02-18 09:12:55 +00:00
wukko
b540e48ffb
api/package: bump version to 10.7.4
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-13 17:19:32 +06:00
wukko
b5ba86dd75
api/youtube: return a proper error if the video is "inappropriate"
2025-02-13 17:09:03 +06:00
wukko
80f9769d88
api/package: bump version to 10.7.3
2025-02-11 16:15:30 +06:00
wukko
4dc7d28696
api/instagram: fall back to photo in extractOldPost if video has no url
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-11 15:42:16 +06:00
jj
d8eda230e8
api/test: fix more twitter tests
2025-02-10 22:10:35 +00:00
jj
92061f2e82
api/run-test: print error code for unexpected errors
2025-02-10 22:06:30 +00:00
jj
fcb5023c23
api/test: always randomize ciphers and override envs
2025-02-10 22:04:57 +00:00
jj
d79950b15f
api/test: clear a bunch of canFails
2025-02-10 22:03:10 +00:00
jj
0426621cf5
api/test: fix twitter bookmarked photo link
2025-02-10 21:59:11 +00:00
jj
a06bad161a
api/test: add env for configuring ignored tests
2025-02-10 21:55:11 +00:00
jj
8f57881a68
api/test: use proxy from external proxy env if available
2025-02-10 21:48:30 +00:00
Satya Ananda
d6b0fbc8ec
api/url: extract loom video id from longer links ( #832 )
...
Co-authored-by: jj <log@riseup.net>
2025-02-11 14:52:20 +06:00
zjy4fun
ca0bc9f395
api/ok: fix author not being handled properly ( #1009 )
2025-02-11 14:42:07 +06:00
wukko
07947882c4
api/package: bump version to 10.7.2
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-10 11:53:49 +06:00
wukko
de69989bbe
api/service-config/instagram: add support for more share links
2025-02-10 11:53:37 +06:00
wukko
8ab5e32390
api/package: bump version to 10.7.1
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-10 00:57:19 +06:00
wukko
09706160a9
api/snapchat: allow profile params to be missing
...
fixes broken story extraction
2025-02-10 00:33:23 +06:00
wukko
a0f227d68b
api/reddit: add support for mobile links & bunch of other links ( #1098 )
...
* api/reddit: extract params from a mobile share link
* api/reddit: add support for a bunch of links & update the api endpoint
also fixed "undefined" in a filename when downloading a user post
* api/service-patterns: fix reddit id pattern
2025-02-10 00:17:48 +06:00
wukko
5306760890
api/package: bump version to 10.7
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2025-02-09 18:31:55 +06:00
wukko
6e653f468b
api/instagram: add a filename to all single images
2025-02-09 18:23:28 +06:00
jj
55f591b37d
api/instagram: add explanation for resolveRedirectingURL user-agent
2025-02-09 11:59:10 +00:00
jj
59cb6b05be
api/test: add test for private instagram posts
2025-02-09 11:50:26 +00:00
wukko
20525d6c7c
api/processing/url: sort imports by line length
2025-02-09 17:49:19 +06:00
wukko
5b63e2e6f2
api/instagram: sort imports by line length
2025-02-09 17:48:49 +06:00
wukko
b3b893b8f3
api/misc/utils: add one (1) line break
2025-02-09 17:48:37 +06:00
wukko
9d2f77949a
api/tests/snapchat: revert story link change
2025-02-09 17:48:00 +06:00
wukko
98dbba5672
api/test: add reddit to finicky list cuz reddit blocked github ips
2025-02-09 17:42:10 +06:00
jj
3f6dd4fced
api/youtube: expect errorInfo to not be json
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-02-08 20:59:53 +00:00
jj
a918b12387
api/tests: fix broken tests
2025-02-08 20:59:27 +00:00
jj
a8cc5bc8bc
api/instagram: update tests
2025-02-08 20:05:49 +00:00
jj
cca61275f1
api/instagram: add support for share urls
...
closes #998
2025-02-08 17:24:02 +00:00
jj
1be13a30bf
api/instagram: age-restricted and private account-specific errors
...
fixes #222
2025-02-08 16:45:31 +00:00
jj
6d18dff5cc
api/bilibili: use shortlink resolver
2025-02-08 16:27:33 +00:00
jj
bbcb2bee7c
api/pinterest: use shortlink resolver
2025-02-08 16:09:49 +00:00
jj
5db5437b62
api/pinterest: fix undefined in name when downloading shortlink
2025-02-08 16:08:34 +00:00
jj
a758b1dbc6
api/snapchat: use shortlink resolver
2025-02-08 16:06:36 +00:00
jj
9e6582b76c
api/xiaohongshu: use shortlink resolver
2025-02-08 16:05:51 +00:00
jj
6e8b4f30c1
api/url: add function for resolving shortlinks
...
motivation: we frequently need to resolve shortlinks to full URLs
let's have a common standard function for doing this safely
instead of reinventing the wheel in every single service module
2025-02-08 13:53:29 +00:00
jj
77dca70792
api/instagram: yet another attempt at resurrection
2025-02-07 22:47:36 +00:00
jj
c48c64240b
api/internal: allow redirects when reading chunks
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-29 21:51:35 +00:00
wukko
906d929333
api/tests/pinterest: update the gif link
...
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
because the id changed???
2025-01-23 22:00:02 +06:00
wukko
7b31817fdb
api/tests/xiaohongshu: update photo test link
2025-01-23 21:58:41 +06:00
wukko
31f6ff9b87
api/tests/loom: update test links
...
the old video is unavailable for an unknown reason. it's unplayable in a regular browser and also loom's own landing page.
2025-01-23 21:51:06 +06:00
wukko
99265d594b
api/readme: update list of supported services & list of dependencies
2025-01-22 14:41:44 +06:00
wukko
cecb8a4c53
api/package: bump version to 10.6
2025-01-21 17:25:45 +06:00
wukko
36d4608ee5
api/bluesky: add support for tenor gifs
2025-01-21 17:18:49 +06:00
jj
ee3ef60a20
api/youtube: expect one of itags to be empty
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-20 20:12:21 +00:00
wukko
0ab3fe4d2a
api: itunnel transplants ( #1065 )
2025-01-21 00:10:49 +06:00
jj
600c769141
api/stream: implement itunnel transplants
2025-01-20 15:55:26 +00:00
jj
c07940bfa4
api/itunnel: pass itunnel object by reference
2025-01-20 15:46:03 +00:00
jj
19ade7c905
api/youtube: return internal metadata for replaying request
2025-01-20 14:47:09 +00:00
jj
7767a5f5bb
api/youtube: add support for pinning client/itag
2025-01-20 14:46:55 +00:00
jj
035825bc05
api: cache original request parameters in stream
2025-01-20 14:38:55 +00:00
wukko
7488c74faf
api/xiaohongshu: clean up the h265-h264 if statement
...
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:46:12 +06:00
wukko
e39b0ae7b3
api/xiaohongshu: deduplicate h264 stream extraction
...
reduce() isn't called on 1 item arrays, so this is just fine
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:41:02 +06:00
wukko
4963c9f128
api/xiaohongshu: remove duplicated extraction error
...
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:37:23 +06:00
wukko
3cbed87c3e
api/xiaohongshu: update initial state extraction regex
...
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:35:53 +06:00
wukko
de5eca19a5
api/utils: replace redirectStatuses array with a set
...
Co-authored-by: jj <log@riseup.net>
2025-01-20 19:30:11 +06:00
wukko
cd0a2a47c9
api/tests/pinterest: update expected photo status
2025-01-20 19:28:35 +06:00
wukko
cd466a418a
api/tests/bsky: fix expected photo test status
2025-01-20 19:24:12 +06:00
wukko
ad6f29a3c8
api/tests: add xiaohongshu tests
2025-01-20 19:21:44 +06:00
wukko
ed8f4353ea
api/processing: add support for xiaohongshu
2025-01-20 19:10:02 +06:00
wukko
63b2681017
api/match-action: always proxy photos
2025-01-20 19:04:31 +06:00
wukko
9bdcb9d821
api/utils: update getRedirectingURL to accept more statuses & dispatcher
2025-01-20 18:51:37 +06:00
jj
ec0d773792
api/youtube: use Math.min instead of ternary operator
2025-01-20 12:38:12 +00:00
jj
0378a1ae15
api/youtube: fix error when downloading stuff from WEB
2025-01-20 12:37:36 +00:00
wukko
ef687750b4
api/tiktok: update domain because dns records for main one are gone
...
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
closes #1057
2025-01-18 17:02:24 +06:00
jj
ce7d553beb
api/match-action: pass audio bitrate when creating tiktok stream
...
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
fixes #996
2025-01-12 16:43:55 +00:00
wukko
50db4d342a
api & web: roll back the default hls change due to doubled CPU usage
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2025-01-08 11:22:05 +06:00
wukko
7db31851d0
api/package: bump version to 10.5.3
2025-01-08 10:58:49 +06:00
wukko
ec019a1b50
api/schema: enable youtubeHLS by default
2025-01-08 10:54:07 +06:00
jj
0f65165671
api/package: bump version to 10.5.2
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-27 17:17:08 +00:00
jj
a14e51d8bd
api: uninstall esbuild
...
also not used for a while anymore
2024-12-27 15:18:57 +00:00
jj
ac3716ae4a
api: uninstall node-cache package
...
not used for a while anymore
2024-12-27 15:16:49 +00:00
wukko
1dc3532c5d
api/package: bump version to 10.5.1
2024-12-23 23:34:14 +06:00
wukko
4d634603e2
api/youtube: fix variable shadowing
...
oops
2024-12-23 23:34:05 +06:00
wukko
7f7281d794
api/package: bump version to 10.5
2024-12-23 23:21:44 +06:00
wukko
c6d0e0bdd5
api/youtube: use poToken, visitorData, and web client with cookies
...
and also decipher media whenever needed, but only if cookies are used
2024-12-23 22:58:16 +06:00
jj
9da3ba60a9
api/youtube: add support for cookies
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
2024-12-23 11:11:48 +00:00
jj
537d1e8b61
api: bump version to 10.4.7
2024-12-22 14:10:31 +00:00
jj
1ed7e74773
api/match-action: pass isHLS when muting audio
...
fixes a bug where HLS status would be ignored if a muted video
was downloaded with HLS enabled
2024-12-22 14:09:16 +00:00
wukko
2e4b76de6e
api/package: bump version to 10.4.6
2024-12-16 00:04:58 +06:00
jj
459b2c8283
api/internal-hls: don't remake chunk istreams if already wrapped
2024-12-15 17:59:47 +00:00
wukko
86a67dee83
api/package: bump version to 10.4.5
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-13 16:03:32 +06:00
wukko
3dafdd825a
api/types/proxy: use default dispatcher instead of a global one
...
this function never gets anything but internal streams, so global proxy (`API_EXTERNAL_PROXY`) is only causing issues here. this commit fixes an issue of cobalt attempting to proxy internal streams, and failing spectacularly.
2024-12-13 16:01:16 +06:00
wukko
5973d70053
api/package: bump version to 10.4.4 & update youtube.js
Run service tests / test service functionality (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
2024-12-12 23:03:00 +06:00
wukko
112866096c
api/url: return a diff error when youtube is disabled on main instance
2024-12-12 23:00:49 +06:00
wukko
e041e376c7
api & web: bump dependencies
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-10 19:55:43 +06:00
wukko
4b8b0a0e9e
api/youtube: don't retrieve the player as cobalt doesn't use it
...
we don't decipher anything lol
2024-12-10 17:30:32 +06:00
wukko
e1b84e7472
api/package: bump version to 10.4.3
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run service tests / test service functionality (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-12-05 00:27:53 +06:00
jj
6f0a8196ff
api/istream: remove icy-metadata header if sent by client
2024-12-04 18:25:25 +00:00
jj
6c39edbc10
api/stream: use dispatcher if passed to istream
2024-12-04 18:17:13 +00:00
wukko
6ca377ded6
api/tiktok: catch unavailable post error
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Waiting to run
Run service tests / test service: ${{ matrix.service }} (push) Blocked by required conditions
Run service tests / test service functionality (push) Waiting to run
Run tests / check lockfile correctness (push) Waiting to run
Run tests / web sanity check (push) Waiting to run
Run tests / api sanity check (push) Waiting to run
2024-12-04 12:28:05 +06:00
wukko
0e5914f66c
api/package: bump version 10.4.2
Run service tests / test service functionality (push) Has been cancelled
CodeQL / Analyze (${{ matrix.language }}) (none, javascript-typescript) (push) Has been cancelled
Run tests / check lockfile correctness (push) Has been cancelled
Run tests / web sanity check (push) Has been cancelled
Run tests / api sanity check (push) Has been cancelled
Run service tests / test service: ${{ matrix.service }} (push) Has been cancelled
2024-11-28 17:53:35 +06:00
wukko
15a0ba30c7
api/tests/vk: add new domain test
2024-11-28 17:32:41 +06:00
wukko
4700682ccb
api/vk: refactor quality picking
2024-11-28 17:32:10 +06:00
wukko
f696335278
api/vk: use proper api, add support for more links, refactor
...
also added support for video access keys
2024-11-28 16:01:26 +06:00
