Commit graph

195 commits

Author SHA1 Message Date
Kagami Sascha Rosylight cee1d5e2d0
chore: integrate misskey-js as a workspace item (git subtree) (#10409)
* Additional changes for the merge

* api-misskey-js
2023-03-30 09:33:19 +09:00
Kagami Sascha Rosylight abdb43c440 Revert "Additional changes for the merge"
This reverts commit efb5e1d1cc.
2023-03-25 08:20:34 +01:00
Kagami Sascha Rosylight efb5e1d1cc Additional changes for the merge 2023-03-25 08:13:30 +01:00
YS 658901a47f
bump aws-sdk to v3 for s3 (#10363)
* indent

* aws-sdk v3移行
2023-03-23 13:48:14 +09:00
syuilo c0bad443ff update deps 2023-03-10 14:00:14 +09:00
tamaina c36e7d1a07
enhance(server): メディアプロキシでico,bmpを読めるように (#10186)
* enhance(server): downloadUrlでContent-Dispositionからファイル名を取得
Resolve #10036
Resolve #4750

* untitled

* オブジェクトストレージのContent-Dispositionのファイル名の拡張子をContent-Typeに添ったものにする

* ✌️

* tiff

* fix filename

* add test

* /files/でもContent-Disposition

* enhance(server): メディアプロキシでico,bmpを読めるように
Fix #10120

* comment

* fix test

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-03-04 19:23:11 +09:00
Kagami Sascha Rosylight 61215e50ff
test(backend): APIテストの復活 (#10163)
* Revert 1c5291f818

* APIテストの復活

* apiテストの移行

* moduleNameMapper修正

* simpleGetでthrowしないように

status確認しているので要らない

* longer timeout

* ローカルでは問題ないのになんで

* case sensitive

* Run Nest instance within the current process

* Skip some setIntervals

* wait for 5 seconds

* kill them all!!

* logHeapUsage: true

* detectOpenHandlesがじゃましているらしい

* maxWorkers=1?

* restore drive api tests

* workerIdleMemoryLimit: 500MB

* 1024MiB

* Wait what
2023-03-03 11:13:12 +09:00
syuilo 76f3bdcdf9 update deps 2023-02-26 18:51:45 +09:00
kabo2468 1c9c9745f5
Windows環境でswcを使うと正常にビルドができない問題の修正 (#10074)
* Update @swc/core to v1.3.36

* Update CHANGELOG.md

* Update CHANGELOG.md
2023-02-25 05:22:36 +09:00
Kagami Sascha Rosylight 9edd0d25c2
Pass --detectOpenHandles to Jest (#9895)
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-02-24 14:37:22 +09:00
Masaya Suzuki 6b52403d05
起動時にRedisの疎通確認を行う (#9832)
* 起動時にRedisの疎通確認を行う

* check:connectをstart内に移動

---------

Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-02-24 14:09:17 +09:00
CaffeinePower cde0eb621d
feat(server): add @swc/core-android-arm64 to optional (#10034)
* feat: add optional swc

* fix: windowsで動かない現象を修正

* fix: fix swc path alias

* fix: docker build時に`Host key verification failed`と言われてgitリポジトリからパッケージをインストールできないのでssh -> htpsに変更

* feat(server): add @swc/core-android-arm64 to optional

* fix: conflict
2023-02-23 16:23:16 +09:00
syuilo 4e23500732 use swc 2023-02-23 15:36:47 +09:00
CaffeinePower b965f5e4a9
feat: swc build in windows (#10032)
* feat: add optional swc

* fix: windowsで動かない現象を修正

* fix: fix swc path alias

* fix: docker build時に`Host key verification failed`と言われてgitリポジトリからパッケージをインストールできないのでssh -> htpsに変更
2023-02-23 15:36:17 +09:00
syuilo d1a69abf81 use tsc for build
Windowsだとエラーが出るため
2023-02-23 11:06:23 +09:00
syuilo 28bea88da0
Update package.json 2023-02-23 10:17:00 +09:00
tamaina f7c6ea93d7
perf(backend): Use swc on pnpm build (#10026)
* perf(backend): Use swc on pnpm build

* update CHANGELOG

* no jest
2023-02-22 23:09:24 +09:00
potpro bd13ea3d2c
MFMのDOM ParserをJSDOMからhappy-domに変更する (#10016)
Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-22 17:32:45 +09:00
syuilo 716ffcace6 update deps 2023-02-20 17:04:57 +09:00
tamaina 980bf1306e
🎨 2FA設定のデザイン向上 / セキュリティキーの名前を変更できるように (#9985)
* wip

* fix

* wip

* wip

* ✌️

* rename key

* 🎨

* update CHANGELOG.md

* パスワードレスログインの判断はサーバーで

* 日本語

* 日本語

* 日本語

* 日本語

* ✌️

* fix

* refactor

* トークン→確認コード

* fix password-less / qr click

* use otpauth

* 日本語

* autocomplete

* パスワードレス設定は外に出す

* 🎨

* 🎨

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-20 16:40:24 +09:00
Kagami Sascha Rosylight dd52be3a01
ci: run typecheck and eslint separately (#9966)
* ci: run typecheck and eslint separately

* fix syntax
2023-02-17 10:57:40 +09:00
tamaina 4e68126c06
enhance(server): URLプレビュー(summaly)はプロキシを通すように (#9905)
* enhance(server): URLプレビュー(summaly)はプロキシを通すように

* update summaly

* update summaly

* 型エラーバスター

* basic.html

* Delete basic.html

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-14 14:17:07 +09:00
syuilo 54df243b90 fix: typeorm migrations not working
Fix #9868
2023-02-11 10:49:17 +09:00
syuilo 1ff14d81c1 update deps 2023-02-09 09:25:31 +09:00
syuilo 825551d64f drop syslog
Close #9774
2023-02-03 15:08:36 +09:00
syuilo 65ed702d87 update deps 2023-02-03 14:44:09 +09:00
syuilo 4b43745e7c fix(test): add @jest/globals 2023-02-02 10:26:29 +09:00
syuilo d8f33bc0af update deps 2023-01-27 11:40:18 +09:00
syuilo 30dce42e03 fix deps 2023-01-25 12:17:53 +09:00
syuilo d4fb201d05 fix(server): node-fetchおよびgotを使う以前の実装に戻す
see #9710
2023-01-25 12:00:04 +09:00
syuilo da274cd458 update deps 2023-01-24 14:49:29 +09:00
syuilo 083fa53d9c update deps 2023-01-23 20:13:18 +09:00
syuilo a3aafa03ad update deps 2023-01-22 04:17:58 +09:00
syuilo b8afabde2c add commands for build with swc 2023-01-19 16:58:09 +09:00
CyberRex 6e2d7e9792
Use pnpm for package manager (#9531)
* Use pnpm for package manager

* Fix

* Change github workflow

* use pnpm in workflow

* fix

* Fix test (e2e/jest)

* Update Dockerfile for pnpm

* Exclude node_modules from file search on VSCode

* Update pnpm-lock.yaml

* Update pnpm-lock.yaml

* Move typescript from devDependencies to dependencies

* Fix Dockerfile

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-01-16 06:08:42 +09:00
syuilo cedb4267ba update deps 2023-01-15 09:19:02 +09:00
syuilo 68e65ed5df update mfm-js 2023-01-14 09:02:33 +09:00
syuilo 74910f8d70 Revert "perf: build backend with swc (#9463)"
This reverts commit 4579d02296.
2023-01-13 09:32:56 +09:00
파링 4579d02296
perf: build backend with swc (#9463)
* feat: build backend with swc

* fix: swc build target

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-01-12 21:05:45 +09:00
tamaina 978a9bbb3b
perf(backend): Use undici instead of node-fetch and got (#9459)
* Implement? HttpFetchService

* ✌️

* remove node-fetch

* fix

* refactor

* fix

* gateway timeout

* UndiciFetcherクラスを追加 (仮コミット, ビルドもstartもさせていない)

* fix

* add logger and fix url preview

* fix ip check

* enhance logger and error handling

* fix

* fix

* clean up

* Use custom fetcher for ApRequest / ApResolver

* bypassProxyはproxyBypassHostsに判断を委譲するように

* set maxRedirections (default 3, ApRequest/ApResolver: 0)

* fix comment

* handle error s3 upload

* add debug message

* no return await

* Revert "no return await"

This reverts commit b5b0dc58a3.

* reduce maxSockets

* apResolverのUndiciFetcherを廃止しapRequestのものを使う、 add ap logger

* Revert "apResolverのUndiciFetcherを廃止しapRequestのものを使う、 add ap logger"

This reverts commit 997243915c.

* add logger

* fix

* change logger name

* safe

* デフォルトでUser-Agentを設定
2023-01-12 21:03:02 +09:00
syuilo 6a18360269 update mfm-js 2023-01-09 16:07:14 +09:00
syuilo 3e7d8b5f17 update deps 2023-01-06 19:59:31 +09:00
syuilo e44f83fb9c update AiScript to 0.12.0 2023-01-03 15:51:49 +09:00
syuilo a9f4217214 update deps 2023-01-02 20:02:51 +09:00
tamaina 8b46edeccf
enhance: Proxy custom emojis to reduce image size and accelerate the frontend (#9431)
* fix(server): /emoji to accept `@.` host expression

* fix(client): use MkEmoji for custom emoji in MkEmojiPicker

* change convertToWebp

* nanka iroiro

* remove

* fix

* nearLosslessは労多くして益少なしなのでやめる

* do not cleanup tmp for development

* update sharp.js to 0.31.3

* mixed: true

* fix MkAutocomplete of 912791b3ab

* clean up

* https://github.com/misskey-dev/misskey/pull/9431#discussion_r1059215943
2022-12-30 12:00:50 +09:00
syuilo 25c8d7782d update deps 2022-12-28 18:28:01 +09:00
syuilo b0e3bc1f03 update deps 2022-12-23 08:58:02 +09:00
tamaina 2fe86fd869
enhance: Vite HMR while yarn dev, and more build tuning (#9361)
* enhance: Vite HMR while yarn dev, and more build tuning

* use localhost

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2022-12-20 13:05:36 +09:00
syuilo 9e9142a110 update depsd 2022-12-19 13:20:47 +09:00
Kagami Sascha Rosylight af9034355c
Remove redundant ts-node things (#9335) 2022-12-18 07:51:31 +09:00
Kagami Sascha Rosylight 4b98920f02
Fix import related TypeScript errors (#9321)
* Add missing @types packages

* Fix TS1272 type only imports

* Fix TS2821 import assertion
2022-12-14 00:01:45 +09:00
Kagami Sascha Rosylight f30d54fe88
Call tsc --noEmit also for backend/client (#9316) 2022-12-13 00:40:30 +09:00
syuilo c5213dddbf update deps 2022-12-10 16:38:41 +09:00
syuilo f1855020ad update dep 2022-12-06 12:31:50 +09:00
syuilo b4be9d270c perf(server): improve syslog performance 2022-12-06 09:38:55 +09:00
syuilo c0c23b135c bull-board復活 2022-12-04 17:33:51 +09:00
syuilo 2b1a673e32 chore: remove needless experimental-json-modules flag 2022-12-04 10:52:53 +09:00
syuilo 69016735be update deps 2022-12-04 10:39:11 +09:00
syuilo 3a7182bfb5
Fastify (#9106)
* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* Update SignupApiService.ts

* wip

* wip

* Update ClientServerService.ts

* wip

* wip

* wip

* Update WellKnownServerService.ts

* wip

* wip

* update des

* wip

* Update ApiServerService.ts

* wip

* update deps

* Update WellKnownServerService.ts

* wip

* update deps

* Update ApiCallService.ts

* Update ApiCallService.ts

* Update ApiServerService.ts
2022-12-03 19:42:05 +09:00
syuilo 594c329dbd update deps 2022-11-29 13:14:57 +09:00
Kainoa Kanter bdbc448d13
refactor: migrate to Yarn Berry (v3.2.1) (#8764)
* Yarn berry

* Add `.yarn` to dockerignore

* Mention in CHANGELOG

* Update Dockerfile

* Proper upgrade to yarn

* use `"packageManager"`

* Replace `install-packages.js` with workspaces

* Replace `install-packages.js` with workspaces

* Typo

* `corepack enable` for linting

* Remove `packages/*/yarn.lock`

* Improve lint workflow

* Update .github/workflows/lint.yml

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>

* Update .github/workflows/lint.yml

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>

* Add `eslint`

* Regenerate yarn.lock

* 🙏‍

* Update lint.yml

🤔

* Fix workflow!

* yarn lint my beloved

* corepack enable for mocha/e2e

* Update CHANGELOG.md

* fix the code that depends on node_modules

* tbh

* tbh

* More yarn workspaces stuff

* 🍀

* Change `browser-image-resizer`

* :finnadie:

* :goberserk:

* :godmode:

* Remove yarnrc for workspaces

* 🙏

* Add proper packages for eslint

* Skip extra install

* New steps for test.yml too

* uhh

* Update .dockerignore

* Update lint.yml

* Update test.yml

* Make client/backend lints seperate workflows

* package.json names

* pnpm = dont change paths

* Fix changelog

* :bowtie:

* I don't know why github workflows hates me...

* test

* ?????

* continue-on-error: true

* Fix yarn.lock

Co-authored-by: ishowta <ishowta@gmail.com>

* add @rollup/pluginutils

* add packageExtensions for chartjs_date-fns

Co-authored-by: acid-chicken <root@acid-chicken.com>

* npm run => yarn

* wip

* yarn node => node

依存関係の記載不足の解消がかなり多いため、yarn nodeは使わない

* fix

* fix http-signature

* fix

* fix

* add packageExtensions

* ✌️

* remove `yarn set version berry`

* yarn install --immutable

Co-authored-by: ishowta <ishowta@gmail.com>

* https://github.com/misskey-dev/misskey/pull/8764#discussion_r885749892

* enable actions/setup-node's global cache

* Update .gitignore

Co-authored-by: iwata <ishowta@gmail.com>

* revival gulp build
66ab7591bf (r885899944)

* fix lockfile

* Update packages/backend/package.json

Co-authored-by: iwata <ishowta@gmail.com>

* remove packagemanager

* `yarn run gulp` in `build` instead of just `gulp`

* Update CHANGELOG.md

* update lockfile

* Add .yarn/cache to gitignore for packages

* ?

* move resolutions

* ✌️

* update lockfie

* update-lockfile

* update yarn.lock

* fix build

* fix

* fix

* fix: add @tensorflow/tfjs

* ダメ

* modify lockfile

* use yarnrc

* update yarnlock

* add jest-mock

* update-lockfile

* update lockfile

* update lockfile

* move jest-mock, update lockfile

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
Co-authored-by: ishowta <ishowta@gmail.com>
2022-11-24 15:39:00 +09:00
syuilo aa8693e8df update deps 2022-11-19 10:25:16 +09:00
syuilo 49daa56a64 update deps 2022-11-13 11:14:07 +09:00
syuilo 5e21fd2caf update deps 2022-10-28 16:08:27 +09:00
syuilo fd5976f378 fix type 2022-09-24 17:07:56 +09:00
syuilo 89ef21e3b0 fix type 2022-09-24 16:53:53 +09:00
syuilo 92bfcb9b60
Update package.json 2022-09-23 04:19:13 +09:00
syuilo 8e6f1508ed use swc for jest 2022-09-22 04:51:16 +09:00
syuilo e7cdc53c7b test 2022-09-21 04:50:16 +09:00
syuilo 320ee29e2a revert blurhash
https://github.com/woltapp/blurhash/issues/202
2022-09-20 07:52:23 +09:00
syuilo 88a6c312e2 update deps 2022-09-20 07:33:27 +09:00
syuilo b75184ec8e
なんかもうめっちゃ変えた 2022-09-18 03:27:08 +09:00
syuilo 7c89a27e61 update deps 2022-09-10 19:14:07 +09:00
Takuya Yoshida 057d1642c8
Update typeorm to 0.3.9 (#9083) 2022-09-06 14:57:46 +09:00
syuilo 47b2e56967 update deps 2022-08-27 16:34:14 +09:00
syuilo dddc076d01 update deps 2022-08-13 18:45:29 +09:00
syuilo 78f061b9db update deps 2022-07-31 22:01:01 +09:00
syuilo f835421d70 update deps 2022-07-25 21:10:06 +09:00
dependabot[bot] ab9fcc863f
chore(deps): bump file-type from 17.1.2 to 17.1.3 in /packages/backend (#9030)
Bumps [file-type](https://github.com/sindresorhus/file-type) from 17.1.2 to 17.1.3.
- [Release notes](https://github.com/sindresorhus/file-type/releases)
- [Commits](https://github.com/sindresorhus/file-type/compare/v17.1.2...v17.1.3)

---
updated-dependencies:
- dependency-name: file-type
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-23 14:40:54 +09:00
syuilo 3acfeb1680 update tfjs 2022-07-23 14:31:15 +09:00
syuilo e30a03b5c4 update deps 2022-07-13 21:37:48 +09:00
nvisser 947f079735
Make tensorflow an optinal dependency (#8986) 2022-07-13 21:00:59 +09:00
syuilo 18206e3cf6 update mfm-js 0.23.0-canary.1 2022-07-10 21:09:37 +09:00
syuilo 49012f8352 update summaly 2022-07-09 18:23:21 +09:00
syuilo e560601815
feat: auto nsfw detection (#8840)
* feat: auto nsfw detection

* ✌️

* Update ja-JP.yml

* Update ja-JP.yml

* ポルノ判定のしきい値を高めに

* エラーハンドリングちゃんとした

* Update ja-JP.yml

* 感度設定を強化

* refactor

* feat: add video support for auto nsfw detection

* rename: image -> media

* .js

* fix: add missing error handling

* fix: use valid pathname instead of using filename due to invalid usage

* perf(nsfw-detection): decode frames

* disable detection of video for some reasons

* perf(nsfw-detection): streamify detection process for video

* disable disallowUploadWhenPredictedAsPorn option

* fix(nsfw-detection): improve reliability

* fix(nsfw-detection): use Math.ceil instead of Math.round

* perf(nsfw-detection): delete tmp frames after used

* fix(nsfw-detection): FSWatcher does not emit ready event

* perf(nsfw-detection): skip black frames

* refactor: strip exists check

* Update package.json

* めっちゃ変えた

* lint

* Update COPYING

* オプションで動画解析できるように

* Update yarn.lock

* Update CHANGELOG.md

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>
2022-07-07 21:06:37 +09:00
syuilo 949dbb3918 feat(server): add fetch-rss api to reduce dependency of external apis 2022-07-02 21:26:33 +09:00
MeiMei 2f65d91ea8
migrate parse5 to 7.0.0 (#8916)
* migrate parse5 to 7.0.0

* fix
2022-07-01 13:48:03 +09:00
syuilo b846ebeb97 use parse5 6.0.1
Fix #8914
2022-07-01 11:07:14 +09:00
syuilo e3bf53ea84 update deps 2022-07-01 00:21:25 +09:00
dependabot[bot] 126011c1a7
chore(deps): bump jsrsasign from 10.5.24 to 10.5.25 in /packages/backend (#8889)
Bumps [jsrsasign](https://github.com/kjur/jsrsasign) from 10.5.24 to 10.5.25.
- [Release notes](https://github.com/kjur/jsrsasign/releases)
- [Changelog](https://github.com/kjur/jsrsasign/blob/master/ChangeLog.txt)
- [Commits](https://github.com/kjur/jsrsasign/compare/10.5.24...10.5.25)

---
updated-dependencies:
- dependency-name: jsrsasign
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-25 16:28:36 +09:00
MeiMei 6f8e3fe366
enhance: Redisをioredisに統一してIPv6サポート (#8869)
* Use ioredis, Supports IPv6 host

https://github.com/misskey-dev/misskey/issues/8862

* Fix import

* order

* a

* i

* fix

* flushdb

* family

* CHANGELOG

* redis_version

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2022-06-24 19:22:19 +09:00
MeiMei 6422cde5f2
enhance: Improve player detection in URL preview (#8849)
* enhance: Improve player detection in URL preview

* CHANGELOG
2022-06-18 16:02:31 +09:00
syuilo ec6b418a23 update deps 2022-06-10 15:06:42 +09:00
syuilo abcd5bc951 update summaly 2022-06-04 17:24:41 +09:00
Johann150 9c80403072
use http-signature module that supports hs2019 (#8635) 2022-05-26 09:12:17 +09:00
syuilo b3ad04fcb0 update deps 2022-05-25 23:28:56 +09:00
MeiMei 6b44fe165b
Supports Unicode Emoji 14.0 (#8699)
* Unicode 14.0 Emoji

* mfm-js@0.22.0

* CHANGELOG

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2022-05-25 16:35:30 +09:00
MeiMei b6794b614b
enhance: Perform port diagnosis at startup only when Listen fails (#8698)
* Change port check

* Comment: disableClustering

* CHANGELOG

* Smart message
2022-05-19 11:49:07 +09:00
syuilo 6de40cf789 fix(server): prevent crash when processing certain PNGs
Fix #8605
2022-05-15 01:16:12 +09:00
iwata 67e1ee41c9
test: Nodeのカスタムローダーを直してテストが動くように (#8625)
* test: Nodeのカスタムローダーを直してテストが動くように

* dev: mochaを呼ぶコマンドにNODE_ENV=testを追加

* Update packages/backend/test/loader.js

Co-authored-by: Johann150 <johann@qwertqwefsday.eu>

* chore: change export style in loader.js

Co-authored-by: Johann150 <johann@qwertqwefsday.eu>
2022-05-14 16:10:20 +09:00