3465 Commits

Author	SHA1	Message	Date
Fijxu	3c5d37810d	Merge remote-tracking branch 'upstream/master'	2025-05-04 14:17:11 -04:00
Fijxu	2d49601066	feat: option to increase the number of videos shown on the popular page	2025-05-04 14:10:37 -04:00
absidue	2c1400c41e	Fix proxying live DASH streams (#4589)	2025-05-03 20:28:19 +00:00
Alex Maras	8fd0b82c38	feat: route to invidious companion on downloads (#5224)	2025-05-03 01:28:18 +02:00
Émilien (perso)	7579adc3a3	fix: fallback other yt clients no url found for adaptive formats (#5262)	2025-05-02 16:57:02 +02:00
Fijxu	05b99df49a	fix(typo): 'Salect' -> 'Select'	2025-04-17 16:55:30 -04:00
Fijxu	ad95f0e2c0	feat(backends): redirect to another backend if one is unavailable ... Only works with cookies for now. Support for numbered backends will be added later since it requires some black magic.	2025-04-14 16:53:09 -04:00
Fijxu	e13800e859	fix: support for I2P backends! (again!)	2025-04-13 18:35:00 -04:00
Fijxu	69e351770d	chore(backends): change logic used to detect if the user accessed via a numbered backend or main domain ... Numbered backends will only work if the domain has a number at the end, for example: inv1.nadeko.net will redirect to backend 1 inv2.nadeko.net will redirect to backend 2 2inv.nadeko.net will use cookies nadeko1.net will redirect to backend 1 The number of the backend in the domain should be always on the end of it to be able to use numbered backends.	2025-04-13 18:18:06 -04:00
Fijxu	3e33c9b70f	redis: update library and use the recently added #ping method	2025-04-13 15:53:54 -04:00
Fijxu	0ce17d91eb	chore(config): change server_id cookie name	2025-04-13 15:53:54 -04:00
Fijxu	b4e146fb60	redis: replace lib by jgaskins/redis ... https://github.com/jgaskins/redis It's faster and in active development, old one gave me this using a TCP connection: test 5.94k (168.34µs) (±56.73%) 144B/op fastest test 5.11k (195.76µs) (±58.89%) 144B/op fastest test 5.48k (182.33µs) (±73.39%) 144B/op fastest test 3.42k (292.56µs) (±66.19%) 144B/op fastest meanwhile, the jgaskins/redis one gives: test 6.96k (143.66µs) (±58.73%) 96.0B/op fastest test 6.36k (157.16µs) (±55.95%) 96.0B/op fastest test 7.06k (141.65µs) (±57.03%) 96.0B/op fastest	2025-04-13 02:30:37 -04:00
Fijxu	7b072200f6	add support for i2p backends and onion numbered backends	2025-04-06 01:33:08 -04:00
syeopite	6c063436d4	Fix issues raised by code review ... Remove explicit `self.` from #process of parsers Remove explicit return tuple in get_issue_template Fix formatting Move inline issue template style to stylesheet Use @id in ProblematicTimelineItem xml repr Fix naming	2025-04-05 12:40:38 -07:00
Fijxu	bbec111997	feat(experimental): minify js files using esbuild	2025-04-05 03:03:04 -03:00
Fijxu	e3d60a0517	fix missing scheme on meta elements ... move scheme logic	2025-04-05 03:03:00 -03:00
Émilien (perso)	0c07e9d27a	chore: set dash by default (#5216)	2025-04-04 14:00:29 +02:00
Fijxu	ce052103e7	deprecate support for external video playback proxy	2025-04-03 03:12:36 -03:00
Fijxu	c57a4f4920	add CSP based on backend selected by the user ... xd	2025-04-03 03:12:36 -03:00
Fijxu	426e7bfbdb	use Host header on img-src 'self' data: CSP	2025-04-03 03:12:36 -03:00
Fijxu	3d85519ec9	Only show embed link on error pages if v query param is present	2025-04-03 03:12:36 -03:00
Fijxu	a74d89b6d9	Safely handle missing current_companion just in case	2025-04-03 03:12:36 -03:00
Fijxu	fd8c40e0da	fix: fix wrong invidious companion logic on backends ... do not change to another companion if request fails	2025-04-03 03:12:36 -03:00
Fijxu	5f1944925b	remove unused Content-Security-Policy generated on every request to watch end embed	2025-04-01 18:51:13 -03:00
Fijxu	015c9ec5d1	support for numbered backends	2025-03-31 19:26:33 -03:00
Fijxu	be9a3794e9	cookies: remove port number from domain if it exists	2025-03-31 01:42:25 -03:00
Fijxu	642b2e8bf0	cookies: replace alternative domains and backend domains by Host header instead	2025-03-31 01:42:25 -03:00
Fijxu	ce97a41301	views/template.ecr: remove trailing | character on backend switcher	2025-03-31 01:42:25 -03:00
Fijxu	b29f5b39de	add note to backend	2025-03-31 00:04:52 -03:00
Fijxu	895745934b	generate CSP each time the backend checker runs instead of each request made to invidious	2025-03-31 00:03:40 -03:00
Fijxu	d47aa3dd6a	feat: do all the backend balancing on the invidious side ... This will make invidious easier to maintain and escalate without the need of an overcomplicated reverse proxy configuration and multiple invidious instances with each one with a different configuration (in this case, invidious companion)	2025-03-30 20:08:15 -03:00
Fijxu	ddf6802d76	chore: add message if checkbackend job is disabled	2025-03-30 19:19:47 -03:00
Fijxu	626fb2d1a8	add option to disable livestreams since they don't work right now	2025-03-29 02:50:19 -03:00
Fijxu	56f309d6bb	Merge remote-tracking branch 'upstream/master'	2025-03-28 21:46:32 -03:00
Émilien (perso)	23ff6135bb	chore: enforce 16 characters for invidious_companion_key (#5220)	2025-03-26 15:27:59 +01:00
Fijxu	7c9f79e1f1	feat: add option to force proxying of videos	2025-03-24 21:15:38 -03:00
syeopite	7b27585454	Support ProblematicTimelineItem in trending feed	2025-03-19 23:50:41 -07:00
syeopite	f7810ba007	Use ProblematicTimelineItem as needed in playlists	2025-03-19 23:32:46 -07:00
syeopite	c288005bfd	Make "show technical details" btn translatable	2025-03-19 22:52:04 -07:00
syeopite	aae5ba01c2	Fix formatting	2025-03-19 22:52:04 -07:00
syeopite	0e0a95430a	Improve JSON repr of ProblematicTimelineItem	2025-03-19 22:52:03 -07:00
syeopite	9de69c0052	Improve design of placeholder item ... Also makes it show the error backtrace	2025-03-19 22:52:03 -07:00
syeopite	94cb80ea81	Handle parse errors gracefully on timeline items ... Prior to this commit, if even a single item fails to parse Invidious will throw out an error. This means that even if everything else on a page can be parsed and rendered without issues, the single problematic item will cause the entire page to be unusable. This commit gracefully handles parse errors by catching and then replacing the problematic item with a new "timeline error" object that represents the parse error. This will allow the rest of the page to be rendered and an error card that will replace the location of the problematic item.	2025-03-19 22:52:03 -07:00
Fijxu	7aba1f7ba3	Revert "Merge branch 'add-prometheus-metrics-endpoint'" ... This reverts commit e5c0f15398 due to https://github.com/iv-org/invidious/pull/3576#issuecomment-2727898574 , reversing changes made to ecacbab2a5.	2025-03-16 23:51:16 -03:00
Fijxu	8be23eb01d	fix: fix checking logic on the backend checker	2025-03-16 23:30:27 -03:00
Fijxu	a44f37563b	chore: add check backends interval configuration option	2025-03-16 23:10:19 -03:00
Fijxu	facd01b52e	feat: add support for encrypted query parameters ... Related: - 6bd0f28d77 - 7eae31613e	2025-03-16 19:54:40 -03:00
Fijxu	db53ee21ee	Merge remote-tracking branch 'upstream/master'	2025-03-14 12:26:53 -03:00
Émilien (perso)	70ff463cc6	Add invidious companion support (#4985) ... * add support for invidious companion * redirect latest_version and dash manifest to invidious companion * fix Shadowing outer local variable `response` * fixing condition for Content-Security-Policy * throw error if inv_sig_helper and invidious_companion used same time * Use sample instead of Random.rand Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com> * Remove debug puts functions Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com> * modify the description for config.example.yaml about invidious companion * move config checks for invidious companion * separate invidious_companion logic + better config.yaml config * fixing "end" misplacement * fix linting + use .empty? * crystal handle decompression already by itself * fix download function when invidious companion used * fix linting * invidious companion always used so always add CSP and redirect latest_version * apply all the suggestions + rework invidious_companion parameter * format watch.cr * fix ameba Redundant use of `Object#to_s` in interpolation * add ability for invidious companion to check request from invidious * Better document private_url and public_url * Better doc for invidious_companion_key * !empty? to present? * skip proxy for invidious companion * fixing format * missing , * add companion pooling http * fix: don't use http proxy when sending requests to companion * fix: logic where we want to have the invidious logic if companion is not used * chore: remove baseurl usage from invidious companion * chore: change from inv-sig-helper to companion for required playback * fix: use puts + add warning for inv-sig-helper deprecated --------- Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com>	2025-03-13 16:44:00 +01:00
syeopite	5c8b4eb379	Warn when po_token, visitor_data and/or inv-sig-helper is not configured (#5202) ... * Warn when required configs for playback is missing * Add link to documentation in warnings * Direct users to /installation instead	2025-03-12 10:11:17 +01:00
Fijxu	a4cb5f094c	fix: add missing check for c.youtube.com host	2025-03-10 15:40:59 -03:00
Fijxu	01ccd55829	feat: add option to change username ... fix: rename subscriptions materialized view of the user too remove materialized views from username change fix: downcase username and limit username lenght (from routes/login.cr) Users that changed their username to something like `User`, were unable to login because the username is downcased on routes/login.cr	2025-03-08 02:47:42 -03:00
Fijxu	8fe965419a	fix: use short_description as description if microformat is not available	2025-03-08 02:47:24 -03:00
Fijxu	fda823593e	fix: handle microformat as nil if is not present on innertube response. ... Videos that return CONTENT_CHECK_REQUIRED do not include the microformat JSON object literal on them. I think it's better to handle microformat as nil instead of raising if microformat is not present.	2025-03-07 00:23:48 -03:00
Fijxu	24e66231df	chore: remove extra function call in check_backends	2025-03-06 20:24:07 -03:00
Fijxu	1001a72297	feat: show status of the instance with a colored dot	2025-03-02 16:35:44 -03:00
Fijxu	e5c0f15398	Merge branch 'add-prometheus-metrics-endpoint' ... From https://github.com/iv-org/invidious/pull/3576	2025-03-01 03:39:21 -03:00
Fijxu	bceb7a61ef	feat: Detect videoplayback proxy from invidious-companion and add it to the CSP header	2025-02-28 20:06:09 -03:00
syeopite	f3d982a885	Update Kemal to 1.6.0 and remove Kilt ... Kilt is unmaintained and the ECR templating logic has been natively integrated into Kemal with the issues previously seen having been resolved. This commit is mostly a precursor to support the next Kemal release which will add the ability to create error handlers for raised exceptions. See https://github.com/kemalcr/kemal/pull/688	2025-02-28 20:04:42 -03:00
Fijxu	27fecf3879	require base_job before the other jobs ... The crystal compiler seems to evaluate `require` in an alphabetical way, so if anyone in the future, wants to add another job and that job is above `base_job.cr` in alphabetical order, the compiler is going to fail with `Error: undefined constant: Invidious::Jobs::BaseJob`. This doesn't fix anything, but it will prevent a future headache.	2025-02-28 20:04:28 -03:00
Fijxu	dd2e999402	require base_job before the other jobs ... The crystal compiler seems to evaluate `require` in an alphabetical way, so if anyone in the future, wants to add another job and that job is above `base_job.cr` in alphabetical order, the compiler is going to fail with `Error: undefined constant: Invidious::Jobs::BaseJob`. This doesn't fix anything, but it will prevent a future headache.	2025-02-28 19:47:22 -03:00
Fijxu	50fa7de901	Merge remote-tracking branch 'upstream/master'	2025-02-27 02:02:47 -03:00
syeopite	adcdb8cb92	Fix lint and formatting	2025-02-26 14:18:50 -08:00
syeopite	fe4fa0480a	Fix HLS being used for non-livestream videos (#5189) ... Invidious does not currently support non-livestream hls playback Originally, the HLS manifest check was essentially a boolean: if the HLS manifest field was present, it was assumed to be a livestream. Some videos include the HLS Manifest but aren't livestreams. In the case where they are livestreams, the video contains a videoType field with the value "Livestream". In the case that they're normal videos, the videoType is "Video". This is exposed via the `video.live_now` property. This commit just checks that `video.live_now` is true before treating it as a livestream	2025-02-26 14:14:29 -08:00
syeopite	dbbcacc955	Images: fix typo in thumbnail logic	2025-02-26 14:13:58 -08:00
syeopite	58ad848d56	Channels: Support YouTube's change to from /community to /posts (#5183)	2025-02-26 14:13:22 -08:00
syeopite	6ac74f4362	Videos: Fix empty response when rv published field is nonexistent (#5162) ... Fixes #5161 by checking recommended videos published field for presence before attempting to parse it in api	2025-02-26 14:09:28 -08:00
syeopite	9fbe3944b0	Channels: Add Courses to channel page and channel API (#5158) ... Closes #5144	2025-02-26 14:08:44 -08:00
syeopite	c5e9447f41	Pick a different instance upon redirect (#5154) ... The automatic instance redirection has the potential to pick the same instance the user is currently on. This is especially prevalent when the instance list is limited in number like how it is today. This PR checks the domain of the instance and ensures that it is not the same as the current instane before redirecting the user to it. Otherwise, it just sends the user to rediret.invidious.io	2025-02-26 14:05:21 -08:00
syeopite	3e329410d1	Add the ability to listen on UNIX sockets (#5112)	2025-02-26 14:04:29 -08:00
syeopite	74dfda150e	i18n: Enable Tamil	2025-02-26 14:02:57 -08:00
syeopite	3d77635a5c	Add API endpoint for fetching transcripts from YouTube (#4788)	2025-02-26 13:56:39 -08:00
syeopite	4ea4878d1a	User: Batch notifications together	2025-02-26 13:55:25 -08:00
syeopite	1f0a89fb5f	RSS: Channel + Playlist improvements (#4298)	2025-02-26 13:55:01 -08:00
syeopite	f95f87e448	Frontend: Add a first page and previous page buttons for channel navigation (#4123)	2025-02-26 13:54:25 -08:00
Fijxu	e76867aaba	feat(Database::Videos): built-in video cache and support for multiple caching backends ... I did this to get rid of Redis compatible DBs and for speed purposes. This is considered experimental, but everything works fine from what I have tested. Here are some benchmarks using the built-in benchmark library of crystal: \# built-in release cache get 19.79M ( 50.54ns) (± 4.12%) 32.0B/op fastest cache insert 7.88k (126.86µs) (± 2.20%) 65.5kB/op fastest cache get 4.31k (232.11µs) (± 5.50%) 104kB/op fastest \# redis release cache get 22.27k ( 44.90µs) (± 6.40%) 264B/op fastest cache insert 4.74k (211.01µs) (± 4.72%) 65.7kB/op fastest cache get 2.51k (399.11µs) (±13.15%) 129kB/op fastest --- OP/s are way higher, and memory usage per call is lower, so it's a win win.	2025-02-26 17:51:54 -03:00
Fijxu	62cc10d2ca	chore: remove unused config properties	2025-02-24 13:32:19 -03:00
Fijxu	9f475c1f2a	feat(dev): add option to disable video cache on the database (for development purposes only)	2025-02-24 13:26:52 -03:00
Fijxu	b3e24c703d	feat(invidious-companion): use connection pool ... From https://github.com/iv-org/invidious/pull/4985#discussion_r1889356705 Thanks syeopite!	2025-02-21 14:12:03 -03:00
Fijxu	d8ecfd9c04	feat(dev): add option to disable CSP (for development purposes only)	2025-02-21 14:09:16 -03:00
Alex Maras	49afbf2a14	Fix an issue with the HLS manifest check for livestream videos ... Originally, the HLS manifest check was essentially a boolean: if the HLS manifest field was present, it was assumed to be a livestream. Some videos include the HLS Manifest but aren't livestreams. In the case where they are livestreams, the video contains a videoType field with the value "Livestream". In the case that they're normal videos, the videoType is "Video". This is exposed via the video.live_now method. This commit just checks that video.live_now is true before treating it as a livestream	2025-02-21 16:30:39 +08:00
Fijxu	99224b9f60	fix(storyboards): Add HOST_URL to CSP so clients are able to get the storyboards from alternative domains)	2025-02-19 01:10:47 -03:00
Fijxu	e0d4272070	Channels: Fix community tab	2025-02-19 01:10:47 -03:00
syeopite	d853b9f6dc	Typo ... Co-authored-by: Samantaz Fox <coding@samantaz.fr>	2025-02-18 14:46:18 -08:00
Fijxu	d70681538a	Channels: Fix community tab	2025-02-18 19:20:55 -03:00
Fijxu	bbc5913b8d	feat(database): support for either Redis or PostgreSQL for video cache	2025-02-18 18:11:05 -03:00
Fijxu	1df1945849	fix(images.cr): use i.ytimg.com instead of i9.ytimg.com for thumbnails	2025-02-18 16:04:48 -03:00
Fijxu	b08f7ab7ac	chore(template.ecr): Add margin because it looks like shit without a banner	2025-02-18 02:54:49 -03:00
syeopite	05c5448bc1	Update Kemal to 1.6.0 and remove Kilt ... Kilt is unmaintained and the ECR templating logic has been natively integrated into Kemal with the issues previously seen having been resolved. This commit is mostly a precursor to support the next Kemal release which will add the ability to create error handlers for raised exceptions. See https://github.com/kemalcr/kemal/pull/688	2025-01-29 11:49:45 -08:00
Drikanis	29219c46a1	fix 5161 by checking recommended videos published field for presence instead of just not nil	2025-01-28 19:40:15 -07:00
epicsam123	a77f083a0a	remove ! on reject	2025-01-26 16:42:59 -05:00
ChunkyProgrammer	eaf47385c5	Add Courses to channel page and channel API	2025-01-25 14:43:39 -05:00
Fijxu	d75d860888	Merge remote-tracking branch 'upstream/master'	2025-01-25 11:51:05 -03:00
Fijxu	f68d7bcbc7	Revert "Videos: Fix audio tracks language." ... Reverting this commit before merging https://github.com/iv-org/invidious/pull/5149 from upstream This reverts commit c61b2963ac.	2025-01-25 11:44:27 -03:00
epicsam123	0fd480bae2	lint edits, refactor	2025-01-25 03:24:38 -05:00
epicsam123	afb0aad7d3	moved comments	2025-01-24 21:54:10 -05:00
epicsam123	6816ded0fa	add missing end statement	2025-01-23 22:17:46 -05:00
epicsam123	0546a73bfa	Pick a different instance upon redirect	2025-01-22 17:33:54 -05:00
syeopite	164d764d55	API: Add a 'published' video parameter for related videos (#4149)	2025-01-22 11:38:12 -08:00
syeopite	4a31da4000	User: Ensure IO is properly closed when importing NewPipe subscriptions (#4346)	2025-01-22 11:36:58 -08:00