Commit graph

199 commits

Author SHA1 Message Date
s1idewhist1e
981d3ee725 Refactor: use rust for native mastodon id conversion (#9786)
This uses [napi-rs](https://napi.rs/) to allow for automatic generation of node bindings for the native code.

I also changed the `isolatedModules` TS flag to false to allow for `static enum` to be shared across modules. It doesn't seem to be necessary for the build system that CK uses.

Currently this method does not work with ID generators with longer IDs. Likely the best solution is to add another key in the database.

Some benchmarks for 1 million conversions:

```
	node, x1_000_000: 2.847s
	rust, x1_000_000: 1.265s
```

There are still optimizations that can be made, but I think this is a good starting point and a good way to bring rust into the CK stack.

Co-authored-by: s1idewhist1e <trombonedude05@gmail.com>
Reviewed-on: https://codeberg.org/calckey/calckey/pulls/9786
Co-authored-by: s1idewhist1e <s1idewhist1e@noreply.codeberg.org>
Co-committed-by: s1idewhist1e <s1idewhist1e@noreply.codeberg.org>
2023-03-31 01:58:28 +00:00
ThatOneCalculator
bf358a2fb3 dev15 2023-03-24 12:45:25 -07:00
ThatOneCalculator
9fa73242a0 chore: 📦 upgrade megalodon 2023-03-23 16:20:21 -07:00
Kaity A
77c12cba8d Add sonic full-text search support (#9714)
This pull request adds support for the [sonic](https://github.com/valeriansaliou/sonic) full text indexing server into Calckey.

In addition to this, a stateful endpoint has been added that will completely (re-)index all notes into any (elasticsearch and/or sonic) indexing server defined in your config at `/api/admin/search/index-all`. It can (optionally) take input data to define the starting point, such as:

```
{"cursor": "9beg3lx6ad"}
```

Currently if both sonic and elasticsearch are defined in the config, sonic will take precedence for searching, but both indexes will continue to be updated for new note creations. Future enhancements may include the ability to choose which indexer to use (or combine multiple).

Co-authored-by: Kaitlyn Allan <kaitlyn.allan@enlabs.cloud>
Reviewed-on: https://codeberg.org/calckey/calckey/pulls/9714
Co-authored-by: Kaity A <supakaity@noreply.codeberg.org>
Co-committed-by: Kaity A <supakaity@noreply.codeberg.org>
2023-03-19 08:26:47 +00:00
cutestnekoaqua
25896f0093 chore: update megalodon 2023-03-18 11:52:18 +01:00
cutestnekoaqua
1c674fcf01 some quick fixes 2023-03-01 15:04:01 +01:00
Cleo John
83494b707d more mastodon work 2023-02-28 17:23:04 +01:00
Masaya Suzuki
00e42db681 Check redis connection
---------

Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-02-23 22:04:47 -08:00
ThatOneCalculator
6333016077 chore: calckey megalodon 2023-02-11 16:20:57 -08:00
ThatOneCalculator
1e7f8c3ab8 chore: up calckey.js 2023-02-11 13:04:22 -08:00
cutestnekoaqua
1b3308bd4b Revert "use formidable instead"
This reverts commit b8406ecaa40c08576d2644b797e05363533b0cfb.
2023-02-11 00:19:52 +01:00
cutestnekoaqua
1d3e01ee8e use formidable instead 2023-02-10 23:50:27 +01:00
cutestnekoaqua
1c0b13a965 Merge branch 'feature/masto-api' into develop 2023-02-10 00:13:20 +01:00
cutestnekoaqua
b1e3c2e1c7 feat: v1 Mastodon API
This commit adds (maybe unstable) support for Mastodons v1 api
also some v2 endpoints, maybe I miss stuff, I dont know.
We will need to test this but it should be kinda stable
and work like (old) butter.

Co-authored-by: Natty <natty.sh.git@gmail.com>
Co-authored-by: cutls <web-pro@cutls.com>
2023-02-09 23:21:50 +01:00
cutestnekoaqua
0756e980d1 wip masto api
co-authored-by: cutls <web-pro@cutls.com>
2023-02-07 22:56:39 +01:00
Asrael
eeee91dcb4 build: reduce container size by removing dev dependencies from final image
This change moves many of the dependencies into devDependencies, by analyzing what is used in the runtime files. Additionally, NPM and apk cache are eliminated with multi-stage builds
2023-02-03 21:38:40 -08:00
CyberRex0
dc8a6b96d8 Add android-arm64 binary for swc 2023-01-13 18:26:22 +00:00
ThatOneCalculator
ef06bdceda close #9463 2023-01-12 20:58:43 -08:00
ThatOneCalculator
ac64087a1e no more eslint 2023-01-12 20:54:33 -08:00
ThatOneCalculator
2aab2de38d refactor: 🎨 rome 2023-01-12 20:40:33 -08:00
Kainoa Kanter
19596a91e4 refactor: 🔨 Use pnpm instead of yarn (#9461)
Reasons:

1. `pnpm` is now an industry standard, being faster and less buggy than `yarn`.
2. Faster build time as builds are concurrent: 63 seconds down to 35 seconds!!
3. Resolves #9412

Co-authored-by: ThatOneCalculator <kainoa@t1c.dev>
Reviewed-on: https://codeberg.org/calckey/calckey/pulls/9461
2023-01-13 04:18:16 +00:00
ThatOneCalculator
0720ee3f73 perf: 👷 build backend with swc
Co-authored-by: pikokr <@paring@pikokr.dev>
2023-01-10 16:48:49 -08:00
ThatOneCalculator
8ab30f125c revert: koa/router 2023-01-10 14:14:40 -08:00
ThatOneCalculator
1ea2d34e5a chore: up pkgs 2023-01-03 15:43:52 -08:00
ThatOneCalculator
20405eda18 Revert "chore: upgrade packages"
This reverts commit 245d3815c61a2b644094df15bf2a37567ff47ce4.
2023-01-03 15:42:57 -08:00
ThatOneCalculator
c7e54f3b59 chore: upgrade packages 2023-01-03 15:12:38 -08:00
ThatOneCalculator
a6324564e2 fixes 2023-01-03 09:12:26 -08:00
cutestnekoaqua
b16f320607 Reproducible Builds 2022-12-27 00:24:19 +01:00
ThatOneCalculator
4d6c51d134 downgrade some packages 2022-12-18 11:13:24 -08:00
ThatOneCalculator
2c8a66ed9d feat: 📦 upgrade to vite 4 2022-12-18 11:03:08 -08:00
ThatOneCalculator
7a8ab8b381 fix calckeyjs 2022-12-12 10:19:18 -08:00
ThatOneCalculator
5a4c74b6ad fix ckjs 2022-12-12 10:04:57 -08:00
ThatOneCalculator
804224f92c Bug fixes, use calckey.js 2022-12-11 19:24:12 -08:00
ThatOneCalculator
1516e24365 final cleanup 2022-12-11 17:49:14 -08:00
cutestnekoaqua
0219ed2c1d integrate migration ui and api backend 2022-12-12 01:54:44 +01:00
ThatOneCalculator
a2d9405824 deprecate node < 18 2022-11-21 16:27:32 -08:00
ThatOneCalculator
eea4855692 upgrade deps 2022-11-18 17:20:34 -08:00
ThatOneCalculator
d8ae9e7be6 chore: ⬆️ upgrade packages 2022-11-16 02:08:33 -08:00
ThatOneCalculator
1529626d05 chore: ⬆️ update deps 2022-11-13 13:14:34 -08:00
ThatOneCalculator
52bc14d4b7 chore: 📦 package upgrades 2022-11-09 17:21:09 -08:00
Francis Dinh
48904ef975 backend: Update sharp to 0.31.2
This fixes a bug where the backend might crash when processing certain images on an ARM64 system.

See https://akkoma.dev/FoundKeyGang/FoundKey/issues/226 and https://github.com/misskey-dev/misskey/issues/8605 for details.
2022-11-08 19:52:08 +01:00
ThatOneCalculator
c6004d9f30 update deps 2022-11-04 13:20:18 -07:00
ThatOneCalculator
3098c180a5 a 2022-11-04 13:12:56 -07:00
ThatOneCalculator
d98c53aa38 OCR image captioning work 2022-10-27 15:01:38 -07:00
ThatOneCalculator
6504c3e06d chore: 📦 Update packages 2022-10-27 14:25:31 -07:00
ThatOneCalculator
3f6aeadcb2 chore: 🔀 Merge upstream to 12.119.0 2022-09-10 12:13:55 -07:00
syuilo
00cac3103c update deps 2022-09-10 19:14:07 +09:00
ThatOneCalculator
87f9e45048 chore: 🔀 Merge upstream 2022-09-09 12:16:58 -07:00
ThatOneCalculator
76abb3a2a2 chore: ⬆️ Upgrade several deps
From yarn upgrade-interactive
2022-09-07 16:23:33 -07:00
Takuya Yoshida
4eb8ae7937 Update typeorm to 0.3.9 (#9083) 2022-09-06 14:57:46 +09:00
ThatOneCalculator
21d76aafab chore: ⬆️ Upgrade TypeORM 2022-09-05 14:53:48 -07:00
ThatOneCalculator
3959698e89 Merge remote-tracking branch 'misskey/develop' into develop 2022-08-27 15:18:59 -07:00
syuilo
9b533e8ec3 update deps 2022-08-27 16:34:14 +09:00
ThatOneCalculator
692a9d9502 fix: 🔒 Up multer to LTS as to avoid CVE-2022-24434 2022-08-17 15:57:16 -07:00
ThatOneCalculator
c1f155ccf7 Merge remote-tracking branch 'misskey/develop' into develop 2022-08-15 15:21:46 -07:00
syuilo
51efbfeec1 update deps 2022-08-13 18:45:29 +09:00
ThatOneCalculator
8abfaebab0 Merge remote-tracking branch 'misskey/develop' into develop 2022-08-04 13:31:54 -07:00
syuilo
3058236d2f update deps 2022-07-31 22:01:01 +09:00
Johann150
2c814b317f remove ms dependency 2022-07-25 13:38:31 -07:00
ThatOneCalculator
f556ec82b2 Merge remote-tracking branch 'misskey/develop' into develop 2022-07-25 10:23:27 -07:00
syuilo
a462544027 update deps 2022-07-25 21:10:06 +09:00
ThatOneCalculator
c54990b0e6 Merge remote-tracking branch 'misskey/develop' into develop 2022-07-23 18:57:23 -07:00
dependabot[bot]
c07d014275 chore(deps): bump file-type from 17.1.2 to 17.1.3 in /packages/backend (#9030)
Bumps [file-type](https://github.com/sindresorhus/file-type) from 17.1.2 to 17.1.3.
- [Release notes](https://github.com/sindresorhus/file-type/releases)
- [Commits](https://github.com/sindresorhus/file-type/compare/v17.1.2...v17.1.3)

---
updated-dependencies:
- dependency-name: file-type
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-23 14:40:54 +09:00
syuilo
0549e62e3a update tfjs 2022-07-23 14:31:15 +09:00
ThatOneCalculator
4ee44087b9 oauth 2022-07-18 22:22:24 -07:00
ThatOneCalculator
3938786fed yarn lol 2022-07-18 22:04:21 -07:00
syuilo
f4eaa9b3ce update deps 2022-07-13 21:37:48 +09:00
nvisser
a60b0dd757 Make tensorflow an optinal dependency (#8986) 2022-07-13 21:00:59 +09:00
syuilo
e8a58722a2 update mfm-js 0.23.0-canary.1 2022-07-10 21:09:37 +09:00
syuilo
fc531766ad update summaly 2022-07-09 18:23:21 +09:00
syuilo
ed5d81859f feat: auto nsfw detection (#8840)
* feat: auto nsfw detection

* ✌️

* Update ja-JP.yml

* Update ja-JP.yml

* ポルノ判定のしきい値を高めに

* エラーハンドリングちゃんとした

* Update ja-JP.yml

* 感度設定を強化

* refactor

* feat: add video support for auto nsfw detection

* rename: image -> media

* .js

* fix: add missing error handling

* fix: use valid pathname instead of using filename due to invalid usage

* perf(nsfw-detection): decode frames

* disable detection of video for some reasons

* perf(nsfw-detection): streamify detection process for video

* disable disallowUploadWhenPredictedAsPorn option

* fix(nsfw-detection): improve reliability

* fix(nsfw-detection): use Math.ceil instead of Math.round

* perf(nsfw-detection): delete tmp frames after used

* fix(nsfw-detection): FSWatcher does not emit ready event

* perf(nsfw-detection): skip black frames

* refactor: strip exists check

* Update package.json

* めっちゃ変えた

* lint

* Update COPYING

* オプションで動画解析できるように

* Update yarn.lock

* Update CHANGELOG.md

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>
2022-07-07 21:06:37 +09:00
tamaina
da6665f5a0 move resolutions 2022-07-05 05:17:37 +00:00
tamaina
247c51b84d Merge branch 'develop' into pr/ThatOneCalculator/8764 2022-07-05 05:16:06 +00:00
syuilo
ddcd10db8e feat(server): add fetch-rss api to reduce dependency of external apis 2022-07-02 21:26:33 +09:00
MeiMei
62d6d106a6 migrate parse5 to 7.0.0 (#8916)
* migrate parse5 to 7.0.0

* fix
2022-07-01 13:48:03 +09:00
syuilo
23c1109fb0 use parse5 6.0.1
Fix #8914
2022-07-01 11:07:14 +09:00
syuilo
66c0059868 update deps 2022-07-01 00:21:25 +09:00
tamaina
fa775220cf Merge branch 'develop' into pr/ThatOneCalculator/8764 2022-06-28 05:08:57 +00:00
dependabot[bot]
a7cf1b30ec chore(deps): bump jsrsasign from 10.5.24 to 10.5.25 in /packages/backend (#8889)
Bumps [jsrsasign](https://github.com/kjur/jsrsasign) from 10.5.24 to 10.5.25.
- [Release notes](https://github.com/kjur/jsrsasign/releases)
- [Changelog](https://github.com/kjur/jsrsasign/blob/master/ChangeLog.txt)
- [Commits](https://github.com/kjur/jsrsasign/compare/10.5.24...10.5.25)

---
updated-dependencies:
- dependency-name: jsrsasign
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-25 16:28:36 +09:00
MeiMei
aef9cb41f3 enhance: Redisをioredisに統一してIPv6サポート (#8869)
* Use ioredis, Supports IPv6 host

https://github.com/misskey-dev/misskey/issues/8862

* Fix import

* order

* a

* i

* fix

* flushdb

* family

* CHANGELOG

* redis_version

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2022-06-24 19:22:19 +09:00
MeiMei
ea7c2ec26f enhance: Improve player detection in URL preview (#8849)
* enhance: Improve player detection in URL preview

* CHANGELOG
2022-06-18 16:02:31 +09:00
tamaina
1e908dc895 remove packagemanager 2022-06-16 21:23:11 +09:00
tamaina
0c4b76a832 Merge branch 'develop' into pr/ThatOneCalculator/8764 2022-06-16 21:19:17 +09:00
syuilo
01011ef9c5 update deps 2022-06-10 15:06:42 +09:00
tamaina
0d4b9f07f3 https://github.com/misskey-dev/misskey/pull/8764#discussion_r885749892 2022-06-04 23:34:23 +09:00
tamaina
2665322b23 Merge branch 'develop' into pr/ThatOneCalculator/8764 2022-06-04 08:34:56 +00:00
syuilo
c9cd88a9db update summaly 2022-06-04 17:24:41 +09:00
tamaina
f595c068f9 yarn node => node
依存関係の記載不足の解消がかなり多いため、yarn nodeは使わない
2022-06-04 08:07:27 +00:00
tamaina
13d924b804 wip 2022-06-04 08:01:02 +00:00
tamaina
064c81bcfe npm run => yarn 2022-06-03 22:39:07 +09:00
ThatOneCalculator
3cff4e6144 pnpm = dont change paths 2022-05-31 19:44:04 -07:00
ThatOneCalculator
1aa7bce3ff package.json names 2022-05-31 19:41:15 -07:00
ThatOneCalculator
bcb2355bbb 🙏 2022-05-31 00:13:41 -07:00
ThatOneCalculator
480a8ffa6d :godmode: 2022-05-30 23:55:47 -07:00
ThatOneCalculator
ee9fb2d5d9 :goberserk: 2022-05-30 21:03:11 -07:00
ThatOneCalculator
6e16bed0a8 More yarn workspaces stuff 2022-05-30 17:31:24 -07:00
ThatOneCalculator
f325574ca1 fix the code that depends on node_modules 2022-05-29 22:19:40 -07:00
ThatOneCalculator
daa6ae548d Yarn berry 2022-05-29 12:40:08 -07:00
Johann150
8d49573447 use http-signature module that supports hs2019 (#8635) 2022-05-26 09:12:17 +09:00
syuilo
cb330fef64 update deps 2022-05-25 23:28:56 +09:00