feat(page-data): complete Phase 4-5, ops UI, and publish integration
Add visitor roles, row-level scope, owner ops APIs, MySQL policy index, Turnstile captcha, browser client SDK, publish-panel dataset binding, acceptance tests, and usage documentation. Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
@@ -72,5 +72,6 @@ Cursor 额外加载:`.cursor/rules/mindspace-publish-chat-finish-guards.mdc`
|
||||
## 仓库惯例
|
||||
|
||||
- 本地开发:`pnpm dev`(见 [README.md](README.md))
|
||||
- Page Data API:见 [docs/page-data-api-usage.md](docs/page-data-api-usage.md);改动相关路径后执行 `npm run verify:page-data`
|
||||
- 生产隔离:[docs/service-isolation-runbook.md](docs/service-isolation-runbook.md)
|
||||
- 发版须 Git commit,禁止本机直 `rsync` 到 `103/105`
|
||||
|
||||
@@ -834,6 +834,19 @@ export async function migrateSchema(pool) {
|
||||
AND c.category_code IN ('public', 'oa')`,
|
||||
);
|
||||
|
||||
await pool.query(`
|
||||
CREATE TABLE IF NOT EXISTS h5_page_data_policy_index (
|
||||
page_id CHAR(36) PRIMARY KEY,
|
||||
owner_user_id CHAR(36) NOT NULL,
|
||||
access_mode VARCHAR(32) NOT NULL,
|
||||
dataset_count INT UNSIGNED NOT NULL DEFAULT 0,
|
||||
scope_hash CHAR(16) NOT NULL,
|
||||
updated_at BIGINT NOT NULL,
|
||||
KEY idx_h5_page_data_policy_owner (owner_user_id, updated_at),
|
||||
CONSTRAINT fk_h5_page_data_policy_owner FOREIGN KEY (owner_user_id) REFERENCES h5_users(id) ON DELETE CASCADE
|
||||
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci
|
||||
`);
|
||||
|
||||
await pool.query(`
|
||||
CREATE TABLE IF NOT EXISTS h5_user_feedback (
|
||||
id CHAR(36) PRIMARY KEY,
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
|
||||
日期: 2026-07-08
|
||||
|
||||
状态: Draft,仅开发设计;本文不代表已实现。
|
||||
状态: 已实现(Phase 1–5 + 产品层);以代码与 `docs/page-data-api-usage.md` 为准。
|
||||
|
||||
## 1. 背景
|
||||
|
||||
|
||||
@@ -0,0 +1,122 @@
|
||||
# Page Data API 使用说明
|
||||
|
||||
面向 MindSpace 页面 owner、Agent 与 HTML 页面开发者。实现细节见 [page-data-api-public-access-plan-20260708.md](architecture/page-data-api-public-access-plan-20260708.md)。
|
||||
|
||||
## 快速路径
|
||||
|
||||
1. **Agent** 用 `private_data_execute` 建表,用 `private_data_register_dataset` 注册 dataset。
|
||||
2. **发布页面** 时在发布面板勾选「启用页面数据」,选择 dataset 与公开能力;或发布后让 Agent 调用 `private_data_set_page_policy`。
|
||||
3. **HTML 页面** 引入 `/assets/page-data-client.js`,用 `MindSpacePageData.createClient({ pageId })` 读写数据。
|
||||
4. **运维** 在 MindSpace 页面详情「页面数据」面板查看日志、导出、撤销令牌、恢复软删除、关闭 dataset。
|
||||
|
||||
## 访问模式与默认能力
|
||||
|
||||
| 发布访问模式 | Page Data 模式 | 默认公开能力 |
|
||||
|-------------|----------------|-------------|
|
||||
| 完全公开 | `public` | 仅 insert |
|
||||
| 口令访问 | `password` | read + insert |
|
||||
| 登录访问 | `login_required` | read + insert + update |
|
||||
|
||||
可在发布面板或策略中逐项覆盖。
|
||||
|
||||
## Owner API(需登录)
|
||||
|
||||
```text
|
||||
GET /api/page-data # 列出已注册 dataset
|
||||
GET /api/page-data/:dataset # 读行
|
||||
POST /api/page-data/:dataset/rows # 插入
|
||||
GET /api/page-data/:dataset/schema
|
||||
GET /api/page-data/:dataset/stats
|
||||
GET /api/page-data/:dataset/export?format=json|csv
|
||||
POST /api/page-data/:dataset/rows/:id/restore
|
||||
|
||||
GET /api/page-data/policies
|
||||
GET /api/page-data/policies/:pageId
|
||||
PUT /api/page-data/policies/:pageId
|
||||
POST /api/page-data/policies/:pageId/apply-publish
|
||||
GET /api/page-data/policies/:pageId/ops
|
||||
GET /api/page-data/policies/:pageId/logs
|
||||
POST /api/page-data/policies/:pageId/tokens/revoke
|
||||
POST /api/page-data/policies/:pageId/password/reset
|
||||
POST /api/page-data/policies/:pageId/datasets/:dataset/close
|
||||
```
|
||||
|
||||
## 公开 API(无需平台登录)
|
||||
|
||||
```text
|
||||
POST /api/public/pages/:pageId/data-auth # 口令页换 token
|
||||
GET /api/public/pages/:pageId/data/:dataset
|
||||
POST /api/public/pages/:pageId/data/:dataset/rows
|
||||
PATCH /api/public/pages/:pageId/data/:dataset/rows/:id
|
||||
DELETE /api/public/pages/:pageId/data/:dataset/rows/:id
|
||||
GET /api/public/pages/:pageId/data/:dataset/schema
|
||||
GET /api/public/pages/:pageId/data/:dataset/stats
|
||||
```
|
||||
|
||||
公开请求可带 `x-page-data-token`(口令/登录会话)。**公开页不能直接传 SQL**,只能提交策略白名单字段。
|
||||
|
||||
## HTML 页面嵌入
|
||||
|
||||
```html
|
||||
<script src="/assets/page-data-client.js"></script>
|
||||
<script>
|
||||
const client = MindSpacePageData.createClient({
|
||||
pageId: '你的页面 UUID',
|
||||
apiBase: '/api',
|
||||
});
|
||||
|
||||
// 口令页先认证
|
||||
// await client.authenticate('页面口令');
|
||||
|
||||
// 列表
|
||||
const { rows } = await client.listRows('signups', { limit: 20 });
|
||||
|
||||
// 提交表单
|
||||
await client.insertRow('signups', { name: '张三', phone: '13800000000' });
|
||||
</script>
|
||||
```
|
||||
|
||||
### 公开表单 + Cloudflare Turnstile
|
||||
|
||||
服务端配置环境变量 `PAGE_DATA_TURNSTILE_SECRET` 后,**完全公开**模式的 insert 必须带验证码。
|
||||
|
||||
```html
|
||||
<script src="/assets/page-data-client.js"></script>
|
||||
<script src="https://challenges.cloudflare.com/turnstile/v0/api.js" async defer></script>
|
||||
<div class="cf-turnstile" data-sitekey="你的站点密钥"></div>
|
||||
<form id="signup">
|
||||
<input name="name" required />
|
||||
<button type="submit">提交</button>
|
||||
</form>
|
||||
<script>
|
||||
const client = MindSpacePageData.createClient({ pageId: '页面UUID' });
|
||||
document.getElementById('signup').addEventListener('submit', async (e) => {
|
||||
e.preventDefault();
|
||||
const name = e.target.name.value.trim();
|
||||
const token = turnstile.getResponse();
|
||||
await client.insertRow('signups', { name }, { turnstileToken: token });
|
||||
turnstile.reset();
|
||||
});
|
||||
</script>
|
||||
```
|
||||
|
||||
验证码 token 也可放在请求体 `turnstile_token` / `captcha_token`,或通过头 `x-page-data-captcha` 传递。
|
||||
|
||||
## Agent MCP 工具
|
||||
|
||||
- `private_data_register_dataset` — 注册 dataset
|
||||
- `private_data_set_page_policy` — 为已发布页写 Page Access Policy
|
||||
- `private_data_close_page_dataset` — 关闭某 dataset 的公开访问
|
||||
|
||||
## 本地验证
|
||||
|
||||
```bash
|
||||
node --test page-data-acceptance.test.mjs page-data-integration.test.mjs page-data-public-service.test.mjs
|
||||
node scripts/run-memind-tests.mjs --mode changed
|
||||
```
|
||||
|
||||
## 安全提醒
|
||||
|
||||
- 公开读默认关闭;开启前确认字段不含敏感信息。
|
||||
- 密码访问无法强身份绑定,仅适合轻量协作。
|
||||
- 生产公开写入建议开启 Turnstile 并监控「页面数据」操作日志。
|
||||
@@ -18,8 +18,9 @@ import { createScheduleService } from './schedule-service.mjs';
|
||||
import { resolveScheduleTimestamp } from './schedule-time.mjs';
|
||||
import { renderLongImage } from './mindspace-long-image.mjs';
|
||||
import { createUserDataSpaceService } from './user-data-space-service.mjs';
|
||||
import { writePageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
import { normalizePageAccessPolicy } from './page-access-policy.mjs';
|
||||
import { writePageAccessPolicy, readPageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
import { closePolicyDataset, normalizePageAccessPolicy } from './page-access-policy.mjs';
|
||||
import { upsertPageDataPolicyIndex } from './page-data-policy-index.mjs';
|
||||
|
||||
const SANDBOX_ROOT = process.argv[2]?.trim() || process.env.SANDBOX_ROOT?.trim();
|
||||
if (!SANDBOX_ROOT) {
|
||||
@@ -287,12 +288,38 @@ const ALL_TOOLS = [
|
||||
datasets: {
|
||||
type: 'object',
|
||||
description:
|
||||
'dataset 授权,例如 { registrations: { insert: true, columns: { insert: ["name","phone"] } } }',
|
||||
'dataset 授权,例如 { registrations: { insert: true, columns: { insert: ["name","phone"] }, rowPolicy: { scope: "own_rows" } } }',
|
||||
},
|
||||
defaultVisitorRole: {
|
||||
type: 'string',
|
||||
description: 'login_required 模式下未列名访问者的默认角色:deny、viewer、editor',
|
||||
},
|
||||
visitors: {
|
||||
type: 'object',
|
||||
description: '访问者角色映射,例如 { "user-2": "editor", "user-3": "viewer" }',
|
||||
},
|
||||
roles: {
|
||||
type: 'object',
|
||||
description: '可选角色权限覆盖,例如 { viewer: { read: true, insert: false } }',
|
||||
},
|
||||
},
|
||||
required: ['pageId', 'accessMode', 'datasets'],
|
||||
},
|
||||
},
|
||||
{
|
||||
name: 'private_data_close_page_dataset',
|
||||
description:
|
||||
'关闭已发布页面的某个 dataset 公开访问能力。写入策略文件并将 read/insert/update/delete 全部关闭。',
|
||||
inputSchema: {
|
||||
type: 'object',
|
||||
properties: {
|
||||
pageId: { type: 'string', description: '页面 ID' },
|
||||
dataset: { type: 'string', description: '要关闭的 dataset 名称' },
|
||||
ownerUserId: { type: 'string', description: '页面 owner 用户 ID,可选,默认当前会话用户' },
|
||||
},
|
||||
required: ['pageId', 'dataset'],
|
||||
},
|
||||
},
|
||||
];
|
||||
|
||||
let quotaPool = null;
|
||||
@@ -554,12 +581,31 @@ async function callTool(name, args) {
|
||||
ownerUserId,
|
||||
accessMode: args.accessMode,
|
||||
datasets: args.datasets,
|
||||
defaultVisitorRole: args.defaultVisitorRole,
|
||||
visitors: args.visitors,
|
||||
roles: args.roles,
|
||||
},
|
||||
{ fallbackPageId: args.pageId, fallbackOwnerUserId: ownerUserId },
|
||||
);
|
||||
const saved = writePageAccessPolicy(SANDBOX, policy);
|
||||
if (isQuotaSyncConfigured()) {
|
||||
await upsertPageDataPolicyIndex(getQuotaPool(), saved).catch(() => null);
|
||||
}
|
||||
return [{ type: 'text', text: JSON.stringify(saved, null, 2) }];
|
||||
}
|
||||
case 'private_data_close_page_dataset': {
|
||||
const ownerUserId = String(args.ownerUserId ?? PRIVATE_DATA_USER_ID ?? '').trim();
|
||||
if (!ownerUserId) throw new Error('缺少 ownerUserId,无法关闭 dataset');
|
||||
const policy = readPageAccessPolicy(SANDBOX, args.pageId);
|
||||
if (!policy) throw new Error('页面数据策略不存在');
|
||||
if (policy.ownerUserId !== ownerUserId) throw new Error('无权关闭该页面 dataset');
|
||||
const closed = closePolicyDataset(policy, args.dataset);
|
||||
const saved = writePageAccessPolicy(SANDBOX, closed);
|
||||
if (isQuotaSyncConfigured()) {
|
||||
await upsertPageDataPolicyIndex(getQuotaPool(), saved).catch(() => null);
|
||||
}
|
||||
return [{ type: 'text', text: JSON.stringify(saved.datasets[args.dataset], null, 2) }];
|
||||
}
|
||||
case 'schedule_create_item': {
|
||||
const timezone = args.timezone ?? process.env.H5_DEFAULT_TIMEZONE ?? 'Asia/Shanghai';
|
||||
const startAt = resolveScheduleTimestamp({
|
||||
|
||||
@@ -132,7 +132,7 @@ test('sandbox MCP exposes and protects the user private data space', async (t) =
|
||||
test('sandbox MCP registers datasets and page policies for Page Data API', async (t) => {
|
||||
const root = fs.mkdtempSync(path.join(os.tmpdir(), 'mindspace-sandbox-page-data-'));
|
||||
const server = startSandbox(root, {
|
||||
ALLOWED_TOOLS: 'private_data_execute,private_data_register_dataset,private_data_set_page_policy',
|
||||
ALLOWED_TOOLS: 'private_data_execute,private_data_register_dataset,private_data_set_page_policy,private_data_close_page_dataset',
|
||||
PRIVATE_DATA_USER_ID: 'user-1',
|
||||
});
|
||||
t.after(() => server.child.kill());
|
||||
@@ -187,6 +187,15 @@ test('sandbox MCP registers datasets and page policies for Page Data API', async
|
||||
const saved = JSON.parse(fs.readFileSync(path.join(root, '.mindspace', 'page-data-policies', 'page-1.json'), 'utf8'));
|
||||
assert.equal(saved.pageId, 'page-1');
|
||||
assert.equal(saved.datasets.signups.insert, true);
|
||||
|
||||
const close = await server.request('tools/call', {
|
||||
name: 'private_data_close_page_dataset',
|
||||
arguments: { pageId: 'page-1', dataset: 'signups' },
|
||||
});
|
||||
assert.equal(close.result.isError, false);
|
||||
const closed = JSON.parse(close.result.content[0].text);
|
||||
assert.equal(closed.closed, true);
|
||||
assert.equal(closed.insert, false);
|
||||
});
|
||||
|
||||
test('sandbox MCP exposes schedule tools only when schedule env is configured', async (t) => {
|
||||
|
||||
+2
-1
@@ -55,13 +55,14 @@
|
||||
"mock:memory-v2-services": "node scripts/mock-memory-v2-services.mjs",
|
||||
"test:memind": "node scripts/run-memind-tests.mjs",
|
||||
"test:scenario": "node scripts/run-scenario-test.mjs",
|
||||
"test": "node --test auth.test.mjs asr-proxy.test.mjs billing.test.mjs billing-recharge.test.mjs wechat-pay.test.mjs wechat-oauth.test.mjs wechat-mp.test.mjs schedule-intent.test.mjs schedule-reminder-worker.test.mjs capabilities.test.mjs policies.test.mjs chat-skills.test.mjs chat-intent-router.test.mjs chat-finish-sync.test.mjs chat-agent-run-gate.test.mjs conversation-display.test.mjs user-publish.test.mjs user-memory-profile.test.mjs skills-registry.test.mjs agent-run-gateway.test.mjs agent-run-routes.test.mjs session-broker.test.mjs sse-event-taxonomy.test.mjs goosed-proxy-boundary.test.mjs agent-run-stream.test.mjs mindspace-h5-html-finish-guard.test.mjs admin-routes.test.mjs direct-chat-service.test.mjs tool-gateway.test.mjs mindspace.test.mjs mindspace-scan.test.mjs mindspace-assets.test.mjs mindspace-local-runtime-services.test.mjs mindspace-local-server-adapter.test.mjs mindspace-public-asset-token.test.mjs mindspace-remote-server-adapter.test.mjs mindspace-server-adapter.test.mjs mindspace-pages.test.mjs mindspace-page-sync-service.test.mjs public-site-bases.test.mjs mindspace-html-download-links.test.mjs mindspace-page-purge.test.mjs mindspace-public-delivery.test.mjs mindspace-public-page-context.test.mjs mindspace-public-route.test.mjs mindspace-publications.test.mjs mindspace-public-links.test.mjs mindspace-chat-save.test.mjs mindspace-chat-docx-package.test.mjs mindspace-public-finish-sync.test.mjs mindspace-chat-context.test.mjs mindspace-canonical-url.test.mjs mindspace-conversation-package.test.mjs mindspace-conversation-package-backfill.test.mjs mindspace-conversation-package-public-html.test.mjs mindspace-conversation-package-verify.test.mjs mindspace-conversation-package-registry.test.mjs mindspace-conversation-package-routes.test.mjs mindspace-conversation-package-store.test.mjs mindspace-conversation-schema.test.mjs mindspace-runtime-config.test.mjs mindspace-service.test.mjs mindspace-storage-adapter.test.mjs mindspace-content-scan.test.mjs mindspace-html-localize.test.mjs mindspace-visual-editor.test.mjs mindspace-cleanup.test.mjs mindspace-thumbnails.test.mjs mindspace-workspace-thumbnails.test.mjs mindspace-workspace-sync.test.mjs mindspace-asset-preview.test.mjs mindspace-agent-jobs.test.mjs mindspace-agent-runner.test.mjs mindspace-sandbox-mcp.test.mjs user-data-space-service.test.mjs page-data-routes.test.mjs page-access-policy.test.mjs page-data-public-service.test.mjs page-data-integration.test.mjs message-stream.test.mjs mindspace-service/mindspace-rpc-server.test.mjs plaza-posts.test.mjs plaza-interactions.test.mjs plaza-algorithm.test.mjs plaza-seo.test.mjs plaza-ops.test.mjs user-auth.test.mjs llm-providers.test.mjs admin-guard.test.mjs user-feedback.test.mjs memory-v2.test.mjs memory-v2-admin-config.test.mjs memory-v2-adapter-scaffold.test.mjs memory-v2-backend-contract.test.mjs memory-v2-health.test.mjs memory-v2-runtime.test.mjs memory-v2-plugin-backends.test.mjs memory-v2-pgvector.test.mjs memory-v2-pgvector-schema.test.mjs memory-v2-pgvector-backfill.test.mjs memory-v2-pgvector-smoke.test.mjs memory-v2-qdrant.test.mjs memory-v2-weaviate.test.mjs memory-v2-mem0.test.mjs memory-v2-letta.test.mjs memory-v2-external-adapters.test.mjs scripts/embed-memory-v2-local-hash.test.mjs scripts/check-memory-v2-app-canary.test.mjs scripts/check-memory-v2-config-gaps.test.mjs scripts/check-memory-v2-contracts.test.mjs scripts/check-memory-v2-health.test.mjs scripts/check-memory-v2-session-flow.test.mjs scripts/check-memory-v2-stack.test.mjs scripts/setup-memory-v2-pgvector-schema.test.mjs scripts/backfill-memory-v2-pgvector.test.mjs scripts/scaffold-memory-v2-backend.test.mjs scripts/smoke-memory-v2-pgvector.test.mjs scripts/smoke-memory-v2-qdrant.test.mjs scripts/smoke-memory-v2-external.test.mjs scripts/mock-memory-v2-services.test.mjs",
|
||||
"test": "node --test auth.test.mjs asr-proxy.test.mjs billing.test.mjs billing-recharge.test.mjs wechat-pay.test.mjs wechat-oauth.test.mjs wechat-mp.test.mjs schedule-intent.test.mjs schedule-reminder-worker.test.mjs capabilities.test.mjs policies.test.mjs chat-skills.test.mjs chat-intent-router.test.mjs chat-finish-sync.test.mjs chat-agent-run-gate.test.mjs conversation-display.test.mjs user-publish.test.mjs user-memory-profile.test.mjs skills-registry.test.mjs agent-run-gateway.test.mjs agent-run-routes.test.mjs session-broker.test.mjs sse-event-taxonomy.test.mjs goosed-proxy-boundary.test.mjs agent-run-stream.test.mjs mindspace-h5-html-finish-guard.test.mjs admin-routes.test.mjs direct-chat-service.test.mjs tool-gateway.test.mjs mindspace.test.mjs mindspace-scan.test.mjs mindspace-assets.test.mjs mindspace-local-runtime-services.test.mjs mindspace-local-server-adapter.test.mjs mindspace-public-asset-token.test.mjs mindspace-remote-server-adapter.test.mjs mindspace-server-adapter.test.mjs mindspace-pages.test.mjs mindspace-page-sync-service.test.mjs public-site-bases.test.mjs mindspace-html-download-links.test.mjs mindspace-page-purge.test.mjs mindspace-public-delivery.test.mjs mindspace-public-page-context.test.mjs mindspace-public-route.test.mjs mindspace-publications.test.mjs mindspace-public-links.test.mjs mindspace-chat-save.test.mjs mindspace-chat-docx-package.test.mjs mindspace-public-finish-sync.test.mjs mindspace-chat-context.test.mjs mindspace-canonical-url.test.mjs mindspace-conversation-package.test.mjs mindspace-conversation-package-backfill.test.mjs mindspace-conversation-package-public-html.test.mjs mindspace-conversation-package-verify.test.mjs mindspace-conversation-package-registry.test.mjs mindspace-conversation-package-routes.test.mjs mindspace-conversation-package-store.test.mjs mindspace-conversation-schema.test.mjs mindspace-runtime-config.test.mjs mindspace-service.test.mjs mindspace-storage-adapter.test.mjs mindspace-content-scan.test.mjs mindspace-html-localize.test.mjs mindspace-visual-editor.test.mjs mindspace-cleanup.test.mjs mindspace-thumbnails.test.mjs mindspace-workspace-thumbnails.test.mjs mindspace-workspace-sync.test.mjs mindspace-asset-preview.test.mjs mindspace-agent-jobs.test.mjs mindspace-agent-runner.test.mjs mindspace-sandbox-mcp.test.mjs user-data-space-service.test.mjs page-data-routes.test.mjs page-access-policy.test.mjs page-access-visitor.test.mjs page-data-public-service.test.mjs page-data-integration.test.mjs page-data-log-store.test.mjs page-data-ops.test.mjs page-data-session-store.test.mjs page-data-browser-client.test.mjs page-data-policy-index.test.mjs message-stream.test.mjs mindspace-service/mindspace-rpc-server.test.mjs plaza-posts.test.mjs plaza-interactions.test.mjs plaza-algorithm.test.mjs plaza-seo.test.mjs plaza-ops.test.mjs user-auth.test.mjs llm-providers.test.mjs admin-guard.test.mjs user-feedback.test.mjs memory-v2.test.mjs memory-v2-admin-config.test.mjs memory-v2-adapter-scaffold.test.mjs memory-v2-backend-contract.test.mjs memory-v2-health.test.mjs memory-v2-runtime.test.mjs memory-v2-plugin-backends.test.mjs memory-v2-pgvector.test.mjs memory-v2-pgvector-schema.test.mjs memory-v2-pgvector-backfill.test.mjs memory-v2-pgvector-smoke.test.mjs memory-v2-qdrant.test.mjs memory-v2-weaviate.test.mjs memory-v2-mem0.test.mjs memory-v2-letta.test.mjs memory-v2-external-adapters.test.mjs scripts/embed-memory-v2-local-hash.test.mjs scripts/check-memory-v2-app-canary.test.mjs scripts/check-memory-v2-config-gaps.test.mjs scripts/check-memory-v2-contracts.test.mjs scripts/check-memory-v2-health.test.mjs scripts/check-memory-v2-session-flow.test.mjs scripts/check-memory-v2-stack.test.mjs scripts/setup-memory-v2-pgvector-schema.test.mjs scripts/backfill-memory-v2-pgvector.test.mjs scripts/scaffold-memory-v2-backend.test.mjs scripts/smoke-memory-v2-pgvector.test.mjs scripts/smoke-memory-v2-qdrant.test.mjs scripts/smoke-memory-v2-external.test.mjs scripts/mock-memory-v2-services.test.mjs",
|
||||
"test:mindspace-service": "node --test mindspace-service/mindspace-rpc-server.test.mjs",
|
||||
"verify:chat-finish-sync": "node scripts/verify-chat-finish-sync.mjs",
|
||||
"verify:public-finish-sync-runtime": "node scripts/verify-public-finish-sync-runtime.mjs",
|
||||
"verify:mindspace-publish-guards": "node scripts/verify-mindspace-publish-guards.mjs",
|
||||
"verify:mindspace-publish-guards:full": "node scripts/verify-mindspace-publish-guards.mjs --with-runtime",
|
||||
"verify:mindspace-page-sync-guards": "node scripts/verify-mindspace-page-sync-guards.mjs",
|
||||
"verify:page-data": "node --test page-data-acceptance.test.mjs page-data-integration.test.mjs page-data-public-service.test.mjs page-data-ops.test.mjs",
|
||||
"verify:wechat-channel-isolation": "node scripts/check-wechat-channel-isolation.mjs",
|
||||
"verify:goosed-proxy-boundary": "node scripts/check-goosed-proxy-boundary.mjs",
|
||||
"verify:h5-session-patches": "node scripts/verify-h5-session-patches.mjs",
|
||||
|
||||
@@ -1,4 +1,9 @@
|
||||
import { assertSafeSqlIdentifier, normalizeDatasetConfig } from './user-data-space-service.mjs';
|
||||
import {
|
||||
normalizeRowPolicy,
|
||||
normalizeRoleOverrides,
|
||||
normalizeVisitorAssignments,
|
||||
} from './page-access-visitor.mjs';
|
||||
|
||||
export const PAGE_DATA_ACCESS_MODES = new Set(['public', 'password', 'login_required']);
|
||||
|
||||
@@ -28,6 +33,9 @@ export function normalizePolicyDataset(name, raw) {
|
||||
maxInsertBytes: Number(raw.limits.maxInsertBytes ?? 8192),
|
||||
}
|
||||
: undefined,
|
||||
rowPolicy: normalizeRowPolicy(raw.rowPolicy ?? raw.row_policy),
|
||||
closed: Boolean(raw.closed),
|
||||
closedAt: raw.closedAt ?? raw.closed_at ?? null,
|
||||
};
|
||||
}
|
||||
|
||||
@@ -48,11 +56,24 @@ export function normalizePageAccessPolicy(raw, { fallbackPageId = null, fallback
|
||||
for (const [name, config] of Object.entries(datasetsInput)) {
|
||||
datasets[assertSafeSqlIdentifier(name, 'dataset 名称')] = normalizePolicyDataset(name, config);
|
||||
}
|
||||
const defaultVisitorRole = String(
|
||||
raw.defaultVisitorRole ??
|
||||
raw.default_visitor_role ??
|
||||
(accessMode === 'login_required' ? 'viewer' : 'deny'),
|
||||
).trim();
|
||||
if (!['deny', 'viewer', 'editor'].includes(defaultVisitorRole)) {
|
||||
throw Object.assign(new Error(`不支持的 defaultVisitorRole:${defaultVisitorRole}`), {
|
||||
code: 'invalid_policy',
|
||||
});
|
||||
}
|
||||
return {
|
||||
pageId,
|
||||
ownerUserId,
|
||||
workspaceRef: String(raw.workspaceRef ?? raw.workspace_ref ?? '').trim() || null,
|
||||
accessMode,
|
||||
defaultVisitorRole,
|
||||
visitors: normalizeVisitorAssignments(raw.visitors),
|
||||
roles: normalizeRoleOverrides(raw.roles),
|
||||
datasets,
|
||||
updatedAt: raw.updatedAt ?? new Date().toISOString(),
|
||||
};
|
||||
@@ -112,6 +133,7 @@ export function defaultDatasetsForAccessMode(accessMode, datasets = {}) {
|
||||
export function policyAllowsAction(policy, datasetName, action) {
|
||||
const dataset = policy?.datasets?.[datasetName];
|
||||
if (!dataset) return false;
|
||||
if (dataset.closed) return false;
|
||||
if (action === 'read') return dataset.read;
|
||||
if (action === 'insert') return dataset.insert;
|
||||
if (action === 'update') return dataset.update;
|
||||
@@ -119,3 +141,94 @@ export function policyAllowsAction(policy, datasetName, action) {
|
||||
if (action === 'hard_delete') return dataset.hardDelete;
|
||||
return false;
|
||||
}
|
||||
|
||||
export function closePolicyDataset(policy, datasetName) {
|
||||
const dataset = policy?.datasets?.[datasetName];
|
||||
if (!dataset) {
|
||||
throw Object.assign(new Error('dataset 未授权'), { code: 'dataset_not_found' });
|
||||
}
|
||||
return {
|
||||
...policy,
|
||||
datasets: {
|
||||
...policy.datasets,
|
||||
[datasetName]: {
|
||||
...dataset,
|
||||
read: false,
|
||||
insert: false,
|
||||
update: false,
|
||||
softDelete: false,
|
||||
hardDelete: false,
|
||||
closed: true,
|
||||
closedAt: new Date().toISOString(),
|
||||
},
|
||||
},
|
||||
updatedAt: new Date().toISOString(),
|
||||
};
|
||||
}
|
||||
|
||||
export function mapPublicationAccessModeToPageData(accessMode) {
|
||||
const mode = String(accessMode ?? '').trim();
|
||||
if (PAGE_DATA_ACCESS_MODES.has(mode)) return mode;
|
||||
return null;
|
||||
}
|
||||
|
||||
export function buildDatasetPolicyFromRegistry(
|
||||
registryDataset,
|
||||
{ read = false, insert = false, update = false, softDelete = false, accessMode = 'public' } = {},
|
||||
) {
|
||||
const rowPolicy =
|
||||
accessMode === 'login_required' && (update || softDelete || read)
|
||||
? { scope: 'own_rows', ownerColumn: 'created_by_user_id' }
|
||||
: null;
|
||||
return normalizePolicyDataset(registryDataset?.name ?? 'dataset', {
|
||||
read: Boolean(read),
|
||||
insert: Boolean(insert),
|
||||
update: Boolean(update),
|
||||
softDelete: Boolean(softDelete),
|
||||
columns: {
|
||||
read: registryDataset?.columns?.read ?? [],
|
||||
insert: registryDataset?.columns?.insert ?? [],
|
||||
update: registryDataset?.columns?.update ?? [],
|
||||
soft_delete: registryDataset?.columns?.soft_delete ?? ['id'],
|
||||
},
|
||||
rowPolicy,
|
||||
});
|
||||
}
|
||||
|
||||
export function buildPageDataPolicyFromPublishInput({
|
||||
pageId,
|
||||
ownerUserId,
|
||||
accessMode,
|
||||
datasetName,
|
||||
registryDataset,
|
||||
capabilities = {},
|
||||
}) {
|
||||
const mappedAccessMode = mapPublicationAccessModeToPageData(accessMode);
|
||||
if (!mappedAccessMode) {
|
||||
throw Object.assign(new Error('当前发布访问模式不支持 Page Data'), { code: 'invalid_policy' });
|
||||
}
|
||||
const defaults =
|
||||
mappedAccessMode === 'public'
|
||||
? { read: false, insert: true, update: false, softDelete: false }
|
||||
: mappedAccessMode === 'password'
|
||||
? { read: true, insert: true, update: false, softDelete: false }
|
||||
: { read: true, insert: true, update: true, softDelete: false };
|
||||
const datasetPolicy = buildDatasetPolicyFromRegistry(registryDataset, {
|
||||
read: capabilities.read ?? defaults.read,
|
||||
insert: capabilities.insert ?? defaults.insert,
|
||||
update: capabilities.update ?? defaults.update,
|
||||
softDelete: capabilities.softDelete ?? defaults.softDelete,
|
||||
accessMode: mappedAccessMode,
|
||||
});
|
||||
return normalizePageAccessPolicy(
|
||||
{
|
||||
pageId,
|
||||
ownerUserId,
|
||||
accessMode: mappedAccessMode,
|
||||
datasets: {
|
||||
[datasetName]: datasetPolicy,
|
||||
},
|
||||
},
|
||||
{ fallbackPageId: pageId, fallbackOwnerUserId: ownerUserId },
|
||||
);
|
||||
}
|
||||
|
||||
@@ -2,6 +2,7 @@ import assert from 'node:assert/strict';
|
||||
import test from 'node:test';
|
||||
import {
|
||||
buildEffectiveDataset,
|
||||
closePolicyDataset,
|
||||
normalizePageAccessPolicy,
|
||||
policyAllowsAction,
|
||||
} from './page-access-policy.mjs';
|
||||
@@ -65,3 +66,17 @@ test('policyAllowsAction respects per-dataset flags', () => {
|
||||
assert.equal(policyAllowsAction(policy, 'ledger', 'insert'), true);
|
||||
assert.equal(policyAllowsAction(policy, 'missing', 'read'), false);
|
||||
});
|
||||
|
||||
test('closePolicyDataset disables all dataset actions', () => {
|
||||
const policy = normalizePageAccessPolicy({
|
||||
pageId: 'page-1',
|
||||
ownerUserId: 'user-1',
|
||||
accessMode: 'password',
|
||||
datasets: {
|
||||
ledger: { read: true, insert: true, update: true, softDelete: true, columns: {} },
|
||||
},
|
||||
});
|
||||
const closed = closePolicyDataset(policy, 'ledger');
|
||||
assert.equal(closed.datasets.ledger.closed, true);
|
||||
assert.equal(policyAllowsAction(closed, 'ledger', 'insert'), false);
|
||||
});
|
||||
|
||||
@@ -0,0 +1,149 @@
|
||||
import { assertSafeSqlIdentifier } from './user-data-space-service.mjs';
|
||||
|
||||
export const PAGE_DATA_VISITOR_ROLES = new Set(['viewer', 'editor', 'owner']);
|
||||
|
||||
export const DEFAULT_ROLE_PERMISSIONS = {
|
||||
viewer: { read: true, insert: false, update: false, softDelete: false },
|
||||
editor: { read: true, insert: true, update: true, softDelete: true },
|
||||
owner: { read: true, insert: true, update: true, softDelete: true, hardDelete: false },
|
||||
};
|
||||
|
||||
export function normalizeRowPolicy(raw) {
|
||||
if (!raw || typeof raw !== 'object') return null;
|
||||
const scope = String(raw.scope ?? 'all_rows').trim();
|
||||
if (!['all_rows', 'own_rows', 'owner_only'].includes(scope)) {
|
||||
throw Object.assign(new Error(`不支持的 rowPolicy.scope:${scope}`), { code: 'invalid_policy' });
|
||||
}
|
||||
const ownerColumn = assertSafeSqlIdentifier(
|
||||
raw.ownerColumn ?? raw.owner_column ?? 'created_by_user_id',
|
||||
'rowPolicy.ownerColumn',
|
||||
);
|
||||
return { scope, ownerColumn };
|
||||
}
|
||||
|
||||
export function normalizeVisitorAssignments(raw) {
|
||||
if (!raw || typeof raw !== 'object') return {};
|
||||
const visitors = {};
|
||||
for (const [userId, value] of Object.entries(raw)) {
|
||||
const visitorId = String(userId ?? '').trim();
|
||||
if (!visitorId) continue;
|
||||
const role = typeof value === 'string' ? value.trim() : String(value?.role ?? '').trim();
|
||||
if (!PAGE_DATA_VISITOR_ROLES.has(role) || role === 'owner') {
|
||||
throw Object.assign(new Error(`访问者角色无效:${role}`), { code: 'invalid_policy' });
|
||||
}
|
||||
visitors[visitorId] = role;
|
||||
}
|
||||
return visitors;
|
||||
}
|
||||
|
||||
export function normalizeRoleOverrides(raw) {
|
||||
if (!raw || typeof raw !== 'object') return {};
|
||||
const roles = {};
|
||||
for (const [roleName, permissions] of Object.entries(raw)) {
|
||||
const role = String(roleName ?? '').trim();
|
||||
if (!PAGE_DATA_VISITOR_ROLES.has(role)) {
|
||||
throw Object.assign(new Error(`角色定义无效:${role}`), { code: 'invalid_policy' });
|
||||
}
|
||||
roles[role] = {
|
||||
read: Boolean(permissions?.read),
|
||||
insert: Boolean(permissions?.insert),
|
||||
update: Boolean(permissions?.update),
|
||||
softDelete: Boolean(permissions?.softDelete ?? permissions?.soft_delete),
|
||||
hardDelete: Boolean(permissions?.hardDelete ?? permissions?.hard_delete),
|
||||
};
|
||||
}
|
||||
return roles;
|
||||
}
|
||||
|
||||
export function resolveVisitorRole(policy, visitorUserId) {
|
||||
const visitorId = String(visitorUserId ?? '').trim();
|
||||
if (!visitorId) return null;
|
||||
if (visitorId === policy.ownerUserId) return 'owner';
|
||||
const assigned = policy.visitors?.[visitorId];
|
||||
if (assigned) return assigned;
|
||||
const defaultRole = String(policy.defaultVisitorRole ?? 'deny').trim();
|
||||
if (defaultRole === 'deny') return null;
|
||||
if (!PAGE_DATA_VISITOR_ROLES.has(defaultRole)) return null;
|
||||
return defaultRole;
|
||||
}
|
||||
|
||||
export function resolveRolePermissions(policy, role) {
|
||||
const defaults = DEFAULT_ROLE_PERMISSIONS[role] ?? DEFAULT_ROLE_PERMISSIONS.viewer;
|
||||
const overrides = policy.roles?.[role];
|
||||
if (!overrides) return { ...defaults };
|
||||
return {
|
||||
read: overrides.read ?? defaults.read,
|
||||
insert: overrides.insert ?? defaults.insert,
|
||||
update: overrides.update ?? defaults.update,
|
||||
softDelete: overrides.softDelete ?? defaults.softDelete,
|
||||
hardDelete: overrides.hardDelete ?? defaults.hardDelete,
|
||||
};
|
||||
}
|
||||
|
||||
export function roleAllowsAction(rolePermissions, action) {
|
||||
if (!rolePermissions) return false;
|
||||
if (action === 'read') return Boolean(rolePermissions.read);
|
||||
if (action === 'insert') return Boolean(rolePermissions.insert);
|
||||
if (action === 'update') return Boolean(rolePermissions.update);
|
||||
if (action === 'soft_delete') return Boolean(rolePermissions.softDelete);
|
||||
if (action === 'hard_delete') return Boolean(rolePermissions.hardDelete);
|
||||
return false;
|
||||
}
|
||||
|
||||
export function buildEffectiveDatasetForRole(registryDataset, policyDataset, rolePermissions) {
|
||||
if (!registryDataset || !policyDataset || !rolePermissions) return null;
|
||||
const actions = [];
|
||||
if (policyDataset.read && rolePermissions.read) actions.push('read');
|
||||
if (policyDataset.insert && rolePermissions.insert) actions.push('insert');
|
||||
if (policyDataset.update && rolePermissions.update) actions.push('update');
|
||||
if (policyDataset.softDelete && rolePermissions.softDelete) actions.push('soft_delete');
|
||||
if (policyDataset.hardDelete && rolePermissions.hardDelete) actions.push('hard_delete');
|
||||
if (!actions.length) return null;
|
||||
const columns = {
|
||||
read: policyDataset.columns?.read ?? registryDataset.columns?.read ?? [],
|
||||
insert: policyDataset.columns?.insert ?? registryDataset.columns?.insert ?? [],
|
||||
update: policyDataset.columns?.update ?? registryDataset.columns?.update ?? [],
|
||||
soft_delete: policyDataset.columns?.soft_delete ?? registryDataset.columns?.soft_delete ?? ['id'],
|
||||
};
|
||||
return {
|
||||
name: registryDataset.name,
|
||||
table: registryDataset.table,
|
||||
description: registryDataset.description,
|
||||
actions,
|
||||
columns,
|
||||
limits: policyDataset.limits ?? registryDataset.limits,
|
||||
rowPolicy: policyDataset.rowPolicy ?? null,
|
||||
};
|
||||
}
|
||||
|
||||
export function resolveRowAccessScope(rowPolicy, {
|
||||
visitorRole,
|
||||
visitorUserId,
|
||||
ownerUserId,
|
||||
tableColumns = [],
|
||||
} = {}) {
|
||||
if (!rowPolicy || rowPolicy.scope === 'all_rows') {
|
||||
return { bypass: true, whereClause: null, ownerColumn: null, visitorUserId };
|
||||
}
|
||||
const isOwner = visitorRole === 'owner' || visitorUserId === ownerUserId;
|
||||
if (rowPolicy.scope === 'owner_only') {
|
||||
if (isOwner) return { bypass: true, whereClause: null, ownerColumn: null, visitorUserId };
|
||||
throw Object.assign(new Error('当前数据集仅页面所有者可访问'), { code: 'row_not_allowed' });
|
||||
}
|
||||
if (rowPolicy.scope === 'own_rows') {
|
||||
if (isOwner) return { bypass: true, whereClause: null, ownerColumn: rowPolicy.ownerColumn, visitorUserId };
|
||||
const column = rowPolicy.ownerColumn;
|
||||
const hasColumn = tableColumns.some((item) => item.name === column);
|
||||
if (!hasColumn) {
|
||||
throw Object.assign(new Error(`行级权限列不存在:${column}`), { code: 'row_policy_invalid' });
|
||||
}
|
||||
const safeVisitorId = String(visitorUserId ?? '').replace(/'/g, "''");
|
||||
return {
|
||||
bypass: false,
|
||||
whereClause: `"${column}" = '${safeVisitorId}'`,
|
||||
ownerColumn: column,
|
||||
visitorUserId,
|
||||
};
|
||||
}
|
||||
return { bypass: true, whereClause: null, ownerColumn: null, visitorUserId };
|
||||
}
|
||||
@@ -0,0 +1,93 @@
|
||||
import assert from 'node:assert/strict';
|
||||
import test from 'node:test';
|
||||
import { normalizePageAccessPolicy } from './page-access-policy.mjs';
|
||||
import {
|
||||
buildEffectiveDatasetForRole,
|
||||
resolveRowAccessScope,
|
||||
resolveVisitorRole,
|
||||
roleAllowsAction,
|
||||
} from './page-access-visitor.mjs';
|
||||
|
||||
test('resolveVisitorRole maps owner, assigned visitors and defaults', () => {
|
||||
const policy = normalizePageAccessPolicy({
|
||||
pageId: 'page-1',
|
||||
ownerUserId: 'owner-1',
|
||||
accessMode: 'login_required',
|
||||
defaultVisitorRole: 'deny',
|
||||
visitors: { 'editor-1': 'editor', 'viewer-1': 'viewer' },
|
||||
datasets: {},
|
||||
});
|
||||
assert.equal(resolveVisitorRole(policy, 'owner-1'), 'owner');
|
||||
assert.equal(resolveVisitorRole(policy, 'editor-1'), 'editor');
|
||||
assert.equal(resolveVisitorRole(policy, 'viewer-1'), 'viewer');
|
||||
assert.equal(resolveVisitorRole(policy, 'stranger-1'), null);
|
||||
});
|
||||
|
||||
test('buildEffectiveDatasetForRole intersects dataset and role permissions', () => {
|
||||
const effective = buildEffectiveDatasetForRole(
|
||||
{
|
||||
name: 'tasks',
|
||||
table: 'tasks',
|
||||
actions: ['read', 'insert', 'update', 'soft_delete'],
|
||||
columns: {
|
||||
read: ['id', 'title'],
|
||||
insert: ['title'],
|
||||
update: ['title'],
|
||||
soft_delete: ['id'],
|
||||
},
|
||||
},
|
||||
{
|
||||
read: true,
|
||||
insert: true,
|
||||
update: true,
|
||||
softDelete: true,
|
||||
columns: {
|
||||
read: ['id', 'title'],
|
||||
insert: ['title'],
|
||||
update: ['title'],
|
||||
},
|
||||
},
|
||||
{ read: true, insert: false, update: false, softDelete: false },
|
||||
);
|
||||
assert.deepEqual(effective.actions, ['read']);
|
||||
assert.equal(roleAllowsAction({ read: true, insert: false }, 'insert'), false);
|
||||
});
|
||||
|
||||
test('resolveRowAccessScope enforces own_rows and owner_only', () => {
|
||||
const ownRows = resolveRowAccessScope(
|
||||
{ scope: 'own_rows', ownerColumn: 'created_by_user_id' },
|
||||
{
|
||||
visitorRole: 'editor',
|
||||
visitorUserId: 'user-a',
|
||||
ownerUserId: 'owner-1',
|
||||
tableColumns: [{ name: 'created_by_user_id' }],
|
||||
},
|
||||
);
|
||||
assert.match(ownRows.whereClause, /created_by_user_id/);
|
||||
assert.match(ownRows.whereClause, /user-a/);
|
||||
|
||||
const ownerBypass = resolveRowAccessScope(
|
||||
{ scope: 'own_rows', ownerColumn: 'created_by_user_id' },
|
||||
{
|
||||
visitorRole: 'owner',
|
||||
visitorUserId: 'owner-1',
|
||||
ownerUserId: 'owner-1',
|
||||
tableColumns: [{ name: 'created_by_user_id' }],
|
||||
},
|
||||
);
|
||||
assert.equal(ownerBypass.whereClause, null);
|
||||
|
||||
assert.throws(
|
||||
() =>
|
||||
resolveRowAccessScope(
|
||||
{ scope: 'owner_only', ownerColumn: 'created_by_user_id' },
|
||||
{
|
||||
visitorRole: 'editor',
|
||||
visitorUserId: 'user-a',
|
||||
ownerUserId: 'owner-1',
|
||||
tableColumns: [],
|
||||
},
|
||||
),
|
||||
(error) => error.code === 'row_not_allowed',
|
||||
);
|
||||
});
|
||||
@@ -0,0 +1,272 @@
|
||||
/**
|
||||
* Page Data API 第一版验收(对应 docs/architecture/page-data-api-public-access-plan-20260708.md §14)
|
||||
*/
|
||||
import assert from 'node:assert/strict';
|
||||
import fs from 'node:fs';
|
||||
import os from 'node:os';
|
||||
import path from 'node:path';
|
||||
import test from 'node:test';
|
||||
import express from 'express';
|
||||
import { attachPageDataRoutes } from './page-data-routes.mjs';
|
||||
import { createPageDataService } from './page-data-service.mjs';
|
||||
import { createPageDataPublicService } from './page-data-public-service.mjs';
|
||||
import { createUserDataSpaceService } from './user-data-space-service.mjs';
|
||||
import { writePageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
|
||||
const PAGE_ID = 'page-acceptance-1';
|
||||
const OWNER_ID = 'user-acceptance-1';
|
||||
|
||||
function createPool(accessMode = 'public') {
|
||||
return {
|
||||
async query(sql, params) {
|
||||
if (sql.includes('FROM h5_publish_records')) {
|
||||
return [
|
||||
[
|
||||
{
|
||||
id: 'pub-acc-1',
|
||||
user_id: OWNER_ID,
|
||||
page_id: PAGE_ID,
|
||||
access_mode: accessMode,
|
||||
password_hash: null,
|
||||
status: 'online',
|
||||
expires_at: null,
|
||||
},
|
||||
],
|
||||
];
|
||||
}
|
||||
if (sql.includes('h5_page_data_policy_index')) {
|
||||
return [[]];
|
||||
}
|
||||
return [[]];
|
||||
},
|
||||
};
|
||||
}
|
||||
|
||||
async function setupWorkspace(workspaceRoot) {
|
||||
const service = createUserDataSpaceService({ workspaceRoot });
|
||||
await service.executeSql(`CREATE TABLE leads (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
name TEXT NOT NULL,
|
||||
note TEXT,
|
||||
secret_field TEXT,
|
||||
created_at TEXT,
|
||||
deleted_at TEXT,
|
||||
deleted_by TEXT
|
||||
);`);
|
||||
await service.upsertDataset({
|
||||
name: 'leads',
|
||||
table: 'leads',
|
||||
description: '线索',
|
||||
actions: ['read', 'insert', 'update', 'soft_delete'],
|
||||
columns: {
|
||||
read: ['id', 'name', 'note', 'created_at'],
|
||||
insert: ['name', 'note'],
|
||||
update: ['note'],
|
||||
soft_delete: ['id'],
|
||||
},
|
||||
});
|
||||
return service;
|
||||
}
|
||||
|
||||
function buildApp(workspaceRoot, pool = createPool('public')) {
|
||||
const pageDataPublicService = createPageDataPublicService({
|
||||
getPool: () => pool,
|
||||
resolveWorkspaceRootForOwner: () => workspaceRoot,
|
||||
});
|
||||
const api = express.Router();
|
||||
api.use(express.json({ limit: '32kb' }));
|
||||
api.use((req, _res, next) => {
|
||||
if (req.headers['x-test-user']) {
|
||||
req.currentUser = { id: OWNER_ID, workspaceRoot };
|
||||
}
|
||||
next();
|
||||
});
|
||||
attachPageDataRoutes(api, {
|
||||
sendData: (res, _req, data, status = 200) => res.status(status).json({ data }),
|
||||
sendError: (res, _req, status, code, message) =>
|
||||
res.status(status).json({ error: { code, message } }),
|
||||
getPageDataService: () =>
|
||||
createPageDataService({
|
||||
getPool: () => pool,
|
||||
resolveWorkspaceRoot: async () => workspaceRoot,
|
||||
}),
|
||||
getPageDataPublicService: () => pageDataPublicService,
|
||||
});
|
||||
const app = express();
|
||||
app.set('trust proxy', true);
|
||||
app.use('/api', api);
|
||||
return app;
|
||||
}
|
||||
|
||||
async function request(app, method, url, { body, headers } = {}) {
|
||||
const server = app.listen(0);
|
||||
try {
|
||||
const { port } = server.address();
|
||||
const response = await fetch(`http://127.0.0.1:${port}${url}`, {
|
||||
method,
|
||||
headers: {
|
||||
...(body ? { 'content-type': 'application/json' } : {}),
|
||||
...headers,
|
||||
},
|
||||
body: body ? JSON.stringify(body) : undefined,
|
||||
});
|
||||
return { status: response.status, body: await response.json() };
|
||||
} finally {
|
||||
await new Promise((resolve) => server.close(resolve));
|
||||
}
|
||||
}
|
||||
|
||||
test('acceptance: agent dataset registry + owner read/insert via Page Data API', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-acc-owner-'));
|
||||
await setupWorkspace(workspaceRoot);
|
||||
const app = buildApp(workspaceRoot);
|
||||
|
||||
const datasets = await request(app, 'GET', '/api/page-data', {
|
||||
headers: { 'x-test-user': '1' },
|
||||
});
|
||||
assert.equal(datasets.status, 200);
|
||||
assert.equal(datasets.body.data.datasets[0].name, 'leads');
|
||||
|
||||
const inserted = await request(app, 'POST', '/api/page-data/leads/rows', {
|
||||
headers: { 'x-test-user': '1' },
|
||||
body: { name: 'Owner 线索', note: '内部' },
|
||||
});
|
||||
assert.equal(inserted.status, 201);
|
||||
|
||||
const listed = await request(app, 'GET', '/api/page-data/leads?limit=10', {
|
||||
headers: { 'x-test-user': '1' },
|
||||
});
|
||||
assert.equal(listed.status, 200);
|
||||
assert.equal(listed.body.data.rows.length, 1);
|
||||
});
|
||||
|
||||
test('acceptance: public insert only when authorized; read/update/delete denied by default', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-acc-public-'));
|
||||
await setupWorkspace(workspaceRoot);
|
||||
writePageAccessPolicy(workspaceRoot, {
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
accessMode: 'public',
|
||||
datasets: {
|
||||
leads: {
|
||||
insert: true,
|
||||
columns: { insert: ['name', 'note'] },
|
||||
},
|
||||
},
|
||||
});
|
||||
const app = buildApp(workspaceRoot);
|
||||
|
||||
const ok = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/leads/rows`, {
|
||||
body: { name: '公开线索' },
|
||||
});
|
||||
assert.equal(ok.status, 201);
|
||||
|
||||
const readDenied = await request(app, 'GET', `/api/public/pages/${PAGE_ID}/data/leads`);
|
||||
assert.equal(readDenied.status, 403);
|
||||
assert.equal(readDenied.body.error.code, 'action_not_allowed');
|
||||
|
||||
const updateDenied = await request(app, 'PATCH', `/api/public/pages/${PAGE_ID}/data/leads/rows/1`, {
|
||||
body: { note: 'hack' },
|
||||
});
|
||||
assert.equal(updateDenied.status, 403);
|
||||
|
||||
const deleteDenied = await request(app, 'DELETE', `/api/public/pages/${PAGE_ID}/data/leads/rows/1`);
|
||||
assert.equal(deleteDenied.status, 403);
|
||||
});
|
||||
|
||||
test('acceptance: unauthorized dataset/action/column and SQL-like keys are rejected', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-acc-deny-'));
|
||||
await setupWorkspace(workspaceRoot);
|
||||
writePageAccessPolicy(workspaceRoot, {
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
accessMode: 'public',
|
||||
datasets: {
|
||||
leads: { insert: true, columns: { insert: ['name'] } },
|
||||
},
|
||||
});
|
||||
const app = buildApp(workspaceRoot);
|
||||
|
||||
const unknownDataset = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/unknown/rows`, {
|
||||
body: { name: 'x' },
|
||||
});
|
||||
assert.equal(unknownDataset.status, 403);
|
||||
|
||||
const badColumn = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/leads/rows`, {
|
||||
body: { name: 'x', secret_field: 'leak' },
|
||||
});
|
||||
assert.equal(badColumn.status, 403);
|
||||
assert.equal(badColumn.body.error.code, 'columns_not_allowed');
|
||||
|
||||
const sqlKey = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/leads/rows`, {
|
||||
body: { name: 'x', sql: 'DROP TABLE leads' },
|
||||
});
|
||||
assert.equal(sqlKey.status, 403);
|
||||
});
|
||||
|
||||
test('acceptance: apply-publish creates policy for published page', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-acc-publish-'));
|
||||
await setupWorkspace(workspaceRoot);
|
||||
const app = buildApp(workspaceRoot);
|
||||
|
||||
const applied = await request(app, 'POST', `/api/page-data/policies/${PAGE_ID}/apply-publish`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
body: {
|
||||
datasetName: 'leads',
|
||||
capabilities: { read: false, insert: true, update: false, softDelete: false },
|
||||
},
|
||||
});
|
||||
assert.equal(applied.status, 200);
|
||||
assert.equal(applied.body.data.policy.datasets.leads.insert, true);
|
||||
assert.equal(applied.body.data.policy.datasets.leads.read, false);
|
||||
|
||||
const publicInsert = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/leads/rows`, {
|
||||
body: { name: '发布后提交' },
|
||||
});
|
||||
assert.equal(publicInsert.status, 201);
|
||||
});
|
||||
|
||||
test('acceptance: turnstile enforced for public insert when secret configured', async () => {
|
||||
const previousSecret = process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
const previousFetch = globalThis.fetch;
|
||||
process.env.PAGE_DATA_TURNSTILE_SECRET = 'acceptance-secret';
|
||||
globalThis.fetch = async (url, init) => {
|
||||
if (String(url).includes('challenges.cloudflare.com')) {
|
||||
return {
|
||||
ok: true,
|
||||
async json() {
|
||||
return { success: true };
|
||||
},
|
||||
};
|
||||
}
|
||||
return previousFetch(url, init);
|
||||
};
|
||||
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-acc-captcha-'));
|
||||
await setupWorkspace(workspaceRoot);
|
||||
writePageAccessPolicy(workspaceRoot, {
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
accessMode: 'public',
|
||||
datasets: { leads: { insert: true, columns: { insert: ['name'] } } },
|
||||
});
|
||||
const app = buildApp(workspaceRoot);
|
||||
|
||||
try {
|
||||
const denied = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/leads/rows`, {
|
||||
body: { name: '无验证码' },
|
||||
});
|
||||
assert.equal(denied.status, 400);
|
||||
assert.equal(denied.body.error.code, 'captcha_required');
|
||||
|
||||
const ok = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/leads/rows`, {
|
||||
headers: { 'x-page-data-captcha': 'token-ok' },
|
||||
body: { name: '有验证码' },
|
||||
});
|
||||
assert.equal(ok.status, 201);
|
||||
} finally {
|
||||
globalThis.fetch = previousFetch;
|
||||
if (previousSecret == null) delete process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
else process.env.PAGE_DATA_TURNSTILE_SECRET = previousSecret;
|
||||
}
|
||||
});
|
||||
@@ -0,0 +1,113 @@
|
||||
function normalizeApiBase(apiBase) {
|
||||
const base = String(apiBase ?? '/api').trim() || '/api';
|
||||
return base.replace(/\/$/, '');
|
||||
}
|
||||
|
||||
export function buildPageDataAuthPath(apiBase, pageId) {
|
||||
const base = normalizeApiBase(apiBase);
|
||||
return `${base}/public/pages/${encodeURIComponent(String(pageId ?? '').trim())}/data-auth`;
|
||||
}
|
||||
|
||||
export function buildPageDataPublicPath(apiBase, pageId, dataset, suffix = '') {
|
||||
const base = normalizeApiBase(apiBase);
|
||||
const safePageId = encodeURIComponent(String(pageId ?? '').trim());
|
||||
const safeDataset = encodeURIComponent(String(dataset ?? '').trim());
|
||||
const tail = suffix ? (suffix.startsWith('/') ? suffix : `/${suffix}`) : '';
|
||||
return `${base}/public/pages/${safePageId}/data/${safeDataset}${tail}`;
|
||||
}
|
||||
|
||||
function buildAuthHeaders(token) {
|
||||
const headers = { accept: 'application/json' };
|
||||
if (token) headers['x-page-data-token'] = token;
|
||||
return headers;
|
||||
}
|
||||
|
||||
async function parseJsonResponse(response) {
|
||||
const payload = await response.json().catch(() => ({}));
|
||||
if (!response.ok) {
|
||||
const error = payload?.error ?? {};
|
||||
throw Object.assign(new Error(error.message ?? '页面数据请求失败'), {
|
||||
code: error.code ?? 'page_data_failed',
|
||||
status: response.status,
|
||||
});
|
||||
}
|
||||
return payload?.data ?? payload;
|
||||
}
|
||||
|
||||
export function createPageDataBrowserClient({
|
||||
pageId,
|
||||
apiBase = '/api',
|
||||
token = null,
|
||||
fetchImpl = globalThis.fetch,
|
||||
} = {}) {
|
||||
if (!pageId) throw new Error('pageId 不能为空');
|
||||
if (typeof fetchImpl !== 'function') throw new Error('fetch 不可用');
|
||||
|
||||
let sessionToken = token;
|
||||
|
||||
async function request(method, path, { body, query, auth = true, extraHeaders = {} } = {}) {
|
||||
const url = new URL(path, typeof window !== 'undefined' ? window.location.origin : 'http://localhost');
|
||||
if (query && typeof query === 'object') {
|
||||
for (const [key, value] of Object.entries(query)) {
|
||||
if (value == null || value === '') continue;
|
||||
url.searchParams.set(key, String(value));
|
||||
}
|
||||
}
|
||||
const headers = {
|
||||
...(body ? { 'content-type': 'application/json' } : {}),
|
||||
...(auth ? buildAuthHeaders(sessionToken) : { accept: 'application/json' }),
|
||||
...(extraHeaders && typeof extraHeaders === 'object' ? extraHeaders : {}),
|
||||
};
|
||||
const response = await fetchImpl(url.toString(), {
|
||||
method,
|
||||
headers,
|
||||
credentials: 'include',
|
||||
body: body ? JSON.stringify(body) : undefined,
|
||||
});
|
||||
return parseJsonResponse(response);
|
||||
}
|
||||
|
||||
return {
|
||||
get pageId() {
|
||||
return pageId;
|
||||
},
|
||||
get token() {
|
||||
return sessionToken;
|
||||
},
|
||||
setToken(nextToken) {
|
||||
sessionToken = nextToken ? String(nextToken) : null;
|
||||
},
|
||||
async authenticate(password) {
|
||||
const result = await request('POST', buildPageDataAuthPath(apiBase, pageId), {
|
||||
body: { password },
|
||||
auth: false,
|
||||
});
|
||||
if (result?.token) sessionToken = result.token;
|
||||
return result;
|
||||
},
|
||||
async listRows(dataset, query = {}) {
|
||||
return request('GET', buildPageDataPublicPath(apiBase, pageId, dataset), { query });
|
||||
},
|
||||
async getSchema(dataset) {
|
||||
return request('GET', buildPageDataPublicPath(apiBase, pageId, dataset, 'schema'));
|
||||
},
|
||||
async getStats(dataset) {
|
||||
return request('GET', buildPageDataPublicPath(apiBase, pageId, dataset, 'stats'));
|
||||
},
|
||||
async insertRow(dataset, row, options = {}) {
|
||||
const captchaToken =
|
||||
options.captchaToken ?? options.turnstileToken ?? options.captcha_token ?? null;
|
||||
const extraHeaders = captchaToken ? { 'x-page-data-captcha': String(captchaToken) } : {};
|
||||
return request('POST', buildPageDataPublicPath(apiBase, pageId, dataset, 'rows'), {
|
||||
body: row,
|
||||
extraHeaders,
|
||||
});
|
||||
},
|
||||
async updateRow(dataset, rowId, row) {
|
||||
return request('PATCH', buildPageDataPublicPath(apiBase, pageId, dataset, `rows/${rowId}`), { body: row });
|
||||
},
|
||||
async deleteRow(dataset, rowId) {
|
||||
return request('DELETE', buildPageDataPublicPath(apiBase, pageId, dataset, `rows/${rowId}`));
|
||||
},
|
||||
};
|
||||
}
|
||||
@@ -0,0 +1,71 @@
|
||||
import assert from 'node:assert/strict';
|
||||
import test from 'node:test';
|
||||
import {
|
||||
buildPageDataAuthPath,
|
||||
buildPageDataPublicPath,
|
||||
createPageDataBrowserClient,
|
||||
} from './page-data-browser-client.mjs';
|
||||
|
||||
test('buildPageDataPublicPath encodes page and dataset segments', () => {
|
||||
assert.equal(
|
||||
buildPageDataPublicPath('/api', 'page 1', 'sign ups', 'rows'),
|
||||
'/api/public/pages/page%201/data/sign%20ups/rows',
|
||||
);
|
||||
assert.equal(buildPageDataAuthPath('/api/', 'page-1'), '/api/public/pages/page-1/data-auth');
|
||||
});
|
||||
|
||||
test('createPageDataBrowserClient sends token header and parses success payload', async () => {
|
||||
const calls = [];
|
||||
const client = createPageDataBrowserClient({
|
||||
pageId: 'page-1',
|
||||
apiBase: '/api',
|
||||
token: 'token-abc',
|
||||
fetchImpl: async (url, init) => {
|
||||
calls.push({ url, init });
|
||||
return {
|
||||
ok: true,
|
||||
async json() {
|
||||
return { data: { rows: [{ id: 1, title: 'A' }] } };
|
||||
},
|
||||
};
|
||||
},
|
||||
});
|
||||
const rows = await client.listRows('tasks', { limit: 5 });
|
||||
assert.equal(rows.rows[0].title, 'A');
|
||||
assert.match(calls[0].url, /\/api\/public\/pages\/page-1\/data\/tasks\?limit=5/);
|
||||
assert.equal(calls[0].init.headers['x-page-data-token'], 'token-abc');
|
||||
assert.equal(calls[0].init.credentials, 'include');
|
||||
});
|
||||
|
||||
test('createPageDataBrowserClient authenticate stores returned token', async () => {
|
||||
const client = createPageDataBrowserClient({
|
||||
pageId: 'page-1',
|
||||
fetchImpl: async () => ({
|
||||
ok: true,
|
||||
async json() {
|
||||
return { data: { token: 'fresh-token', expiresAt: Date.now() + 1000 } };
|
||||
},
|
||||
}),
|
||||
});
|
||||
const auth = await client.authenticate('secret-pass');
|
||||
assert.equal(auth.token, 'fresh-token');
|
||||
assert.equal(client.token, 'fresh-token');
|
||||
});
|
||||
|
||||
test('createPageDataBrowserClient insertRow sends captcha header when provided', async () => {
|
||||
const calls = [];
|
||||
const client = createPageDataBrowserClient({
|
||||
pageId: 'page-1',
|
||||
fetchImpl: async (url, init) => {
|
||||
calls.push({ url, init });
|
||||
return {
|
||||
ok: true,
|
||||
async json() {
|
||||
return { data: { row: { id: 1, title: 'A' } } };
|
||||
},
|
||||
};
|
||||
},
|
||||
});
|
||||
await client.insertRow('signups', { name: 'A' }, { turnstileToken: 'captcha-123' });
|
||||
assert.equal(calls[0].init.headers['x-page-data-captcha'], 'captcha-123');
|
||||
});
|
||||
@@ -0,0 +1,58 @@
|
||||
const TURNSTILE_VERIFY_URL = 'https://challenges.cloudflare.com/turnstile/v0/siteverify';
|
||||
|
||||
export function isPageDataCaptchaEnabled() {
|
||||
return Boolean(String(process.env.PAGE_DATA_TURNSTILE_SECRET ?? '').trim());
|
||||
}
|
||||
|
||||
export async function verifyPageDataCaptcha(token, remoteIp, { fetchImpl = globalThis.fetch } = {}) {
|
||||
const secret = String(process.env.PAGE_DATA_TURNSTILE_SECRET ?? '').trim();
|
||||
if (!secret) {
|
||||
return { ok: true, skipped: true };
|
||||
}
|
||||
const responseToken = String(token ?? '').trim();
|
||||
if (!responseToken) {
|
||||
throw Object.assign(new Error('提交表单需要验证码'), { code: 'captcha_required', status: 400 });
|
||||
}
|
||||
const body = new URLSearchParams({
|
||||
secret,
|
||||
response: responseToken,
|
||||
});
|
||||
if (remoteIp) body.set('remoteip', String(remoteIp));
|
||||
const response = await fetchImpl(TURNSTILE_VERIFY_URL, {
|
||||
method: 'POST',
|
||||
headers: { 'content-type': 'application/x-www-form-urlencoded' },
|
||||
body: body.toString(),
|
||||
});
|
||||
const payload = await response.json().catch(() => ({}));
|
||||
if (!payload?.success) {
|
||||
throw Object.assign(new Error('验证码校验失败'), {
|
||||
code: 'captcha_invalid',
|
||||
status: 403,
|
||||
});
|
||||
}
|
||||
return { ok: true, skipped: false };
|
||||
}
|
||||
|
||||
export function extractPageDataCaptchaToken(req, payload) {
|
||||
return (
|
||||
String(req.headers?.['x-page-data-captcha'] ?? '').trim() ||
|
||||
String(payload?.turnstile_token ?? payload?.turnstileToken ?? payload?.captcha_token ?? '').trim() ||
|
||||
null
|
||||
);
|
||||
}
|
||||
|
||||
export const PAGE_DATA_META_FIELDS = new Set([
|
||||
'turnstile_token',
|
||||
'turnstileToken',
|
||||
'captcha_token',
|
||||
'updated_by_label',
|
||||
]);
|
||||
|
||||
export function stripPageDataMetaFields(payload) {
|
||||
if (!payload || typeof payload !== 'object' || Array.isArray(payload)) return payload;
|
||||
const cleaned = { ...payload };
|
||||
for (const key of PAGE_DATA_META_FIELDS) {
|
||||
delete cleaned[key];
|
||||
}
|
||||
return cleaned;
|
||||
}
|
||||
@@ -0,0 +1,74 @@
|
||||
import assert from 'node:assert/strict';
|
||||
import test from 'node:test';
|
||||
import {
|
||||
extractPageDataCaptchaToken,
|
||||
stripPageDataMetaFields,
|
||||
verifyPageDataCaptcha,
|
||||
} from './page-data-captcha.mjs';
|
||||
import {
|
||||
buildPageDataPolicyFromPublishInput,
|
||||
mapPublicationAccessModeToPageData,
|
||||
} from './page-access-policy.mjs';
|
||||
|
||||
test('stripPageDataMetaFields removes captcha and meta keys', () => {
|
||||
assert.deepEqual(
|
||||
stripPageDataMetaFields({ name: '张三', turnstile_token: 'abc', updated_by_label: 'x' }),
|
||||
{ name: '张三' },
|
||||
);
|
||||
});
|
||||
|
||||
test('verifyPageDataCaptcha skips when secret is not configured', async () => {
|
||||
const prev = process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
delete process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
try {
|
||||
const result = await verifyPageDataCaptcha(null, '127.0.0.1');
|
||||
assert.equal(result.skipped, true);
|
||||
} finally {
|
||||
if (prev) process.env.PAGE_DATA_TURNSTILE_SECRET = prev;
|
||||
}
|
||||
});
|
||||
|
||||
test('verifyPageDataCaptcha rejects missing token when enabled', async () => {
|
||||
const prev = process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
process.env.PAGE_DATA_TURNSTILE_SECRET = 'test-secret';
|
||||
try {
|
||||
await assert.rejects(
|
||||
() => verifyPageDataCaptcha('', '127.0.0.1'),
|
||||
(error) => error.code === 'captcha_required',
|
||||
);
|
||||
} finally {
|
||||
if (prev) process.env.PAGE_DATA_TURNSTILE_SECRET = prev;
|
||||
else delete process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
}
|
||||
});
|
||||
|
||||
test('extractPageDataCaptchaToken reads header and body fields', () => {
|
||||
assert.equal(
|
||||
extractPageDataCaptchaToken({ headers: { 'x-page-data-captcha': 'hdr' } }, {}),
|
||||
'hdr',
|
||||
);
|
||||
assert.equal(extractPageDataCaptchaToken({}, { turnstile_token: 'body' }), 'body');
|
||||
});
|
||||
|
||||
test('buildPageDataPolicyFromPublishInput applies defaults by access mode', () => {
|
||||
const policy = buildPageDataPolicyFromPublishInput({
|
||||
pageId: 'page-1',
|
||||
ownerUserId: 'user-1',
|
||||
accessMode: 'public',
|
||||
datasetName: 'signups',
|
||||
registryDataset: {
|
||||
name: 'signups',
|
||||
table: 'signups',
|
||||
columns: {
|
||||
read: ['id', 'name'],
|
||||
insert: ['name', 'phone'],
|
||||
update: ['status'],
|
||||
soft_delete: ['id'],
|
||||
},
|
||||
},
|
||||
});
|
||||
assert.equal(policy.accessMode, 'public');
|
||||
assert.equal(policy.datasets.signups.insert, true);
|
||||
assert.equal(policy.datasets.signups.read, false);
|
||||
assert.equal(mapPublicationAccessModeToPageData('private_link'), null);
|
||||
});
|
||||
@@ -55,6 +55,33 @@ async function setupWorkspace(workspaceRoot) {
|
||||
return service;
|
||||
}
|
||||
|
||||
async function setupPublicWorkspace(workspaceRoot) {
|
||||
const service = createUserDataSpaceService({ workspaceRoot });
|
||||
await service.executeSql(`CREATE TABLE signups (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
name TEXT NOT NULL,
|
||||
phone TEXT,
|
||||
status TEXT DEFAULT 'pending',
|
||||
created_at TEXT,
|
||||
deleted_at TEXT,
|
||||
deleted_by TEXT,
|
||||
updated_at TEXT,
|
||||
updated_by_label TEXT
|
||||
);`);
|
||||
await service.upsertDataset({
|
||||
name: 'signups',
|
||||
table: 'signups',
|
||||
actions: ['read', 'insert', 'update', 'soft_delete'],
|
||||
columns: {
|
||||
read: ['id', 'name', 'phone', 'status', 'created_at'],
|
||||
insert: ['name', 'phone', 'status'],
|
||||
update: ['status'],
|
||||
soft_delete: ['id'],
|
||||
},
|
||||
});
|
||||
return service;
|
||||
}
|
||||
|
||||
function buildApp(workspaceRoot) {
|
||||
const pageDataPublicService = createPageDataPublicService({
|
||||
getPool: () => createPool('public'),
|
||||
@@ -252,3 +279,71 @@ test('integration: password publication flow still works for read after data-aut
|
||||
assert.equal(listed.status, 200);
|
||||
assert.equal(listed.body.data.rows[0].title, '口令可见');
|
||||
});
|
||||
|
||||
test('integration: public insert writes operation logs for owner review', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-logs-int-'));
|
||||
await setupPublicWorkspace(workspaceRoot);
|
||||
const app = buildApp(workspaceRoot);
|
||||
await request(app, 'PUT', `/api/page-data/policies/${PAGE_ID}`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
body: {
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
accessMode: 'public',
|
||||
datasets: { signups: { insert: true, columns: { insert: ['name', 'phone', 'status'] } } },
|
||||
},
|
||||
});
|
||||
await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/signups/rows`, {
|
||||
body: { name: '日志测试', phone: '13800000000' },
|
||||
});
|
||||
const logs = await request(app, 'GET', `/api/page-data/policies/${PAGE_ID}/logs`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
});
|
||||
assert.equal(logs.status, 200);
|
||||
assert.equal(logs.body.data.logs.length, 1);
|
||||
assert.equal(logs.body.data.logs[0].action, 'insert');
|
||||
assert.equal(logs.body.data.logs[0].dataset, 'signups');
|
||||
});
|
||||
|
||||
test('integration: owner can export dataset and restore soft-deleted rows', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-owner-ops-'));
|
||||
const ownerService = await setupPublicWorkspace(workspaceRoot);
|
||||
const inserted = await ownerService.insertDatasetRow('signups', {
|
||||
name: '导出项',
|
||||
phone: '13800000001',
|
||||
});
|
||||
const app = buildApp(workspaceRoot);
|
||||
const exported = await request(app, 'GET', '/api/page-data/signups/export?format=json', {
|
||||
headers: { 'x-test-user': '1' },
|
||||
});
|
||||
assert.equal(exported.status, 200);
|
||||
assert.equal(exported.body.data.rowCount, 1);
|
||||
|
||||
await ownerService.softDeleteRowForDataset(ownerService.getDataset('signups'), inserted.row.id, {
|
||||
deletedBy: 'test',
|
||||
});
|
||||
const restored = await request(app, 'POST', `/api/page-data/signups/rows/${inserted.row.id}/restore`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
});
|
||||
assert.equal(restored.status, 200);
|
||||
assert.equal(restored.body.data.restored, true);
|
||||
});
|
||||
|
||||
test('integration: apply-publish route binds dataset after publication', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-apply-publish-route-'));
|
||||
await setupPublicWorkspace(workspaceRoot);
|
||||
const app = buildApp(workspaceRoot);
|
||||
|
||||
const applied = await request(app, 'POST', `/api/page-data/policies/${PAGE_ID}/apply-publish`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
body: {
|
||||
datasetName: 'signups',
|
||||
capabilities: { read: true, insert: true, update: false, softDelete: false },
|
||||
},
|
||||
});
|
||||
assert.equal(applied.status, 200);
|
||||
assert.equal(applied.body.data.policy.datasets.signups.read, true);
|
||||
|
||||
const publicRead = await request(app, 'GET', `/api/public/pages/${PAGE_ID}/data/signups`);
|
||||
assert.equal(publicRead.status, 403);
|
||||
});
|
||||
|
||||
@@ -0,0 +1,47 @@
|
||||
import fs from 'node:fs';
|
||||
import path from 'node:path';
|
||||
|
||||
const DEFAULT_MAX_LOG_BYTES = 2 * 1024 * 1024;
|
||||
|
||||
export function resolvePageDataLogDir(workspaceRoot) {
|
||||
return path.join(workspaceRoot, '.mindspace', 'page-data-logs');
|
||||
}
|
||||
|
||||
export function resolvePageDataLogPath(workspaceRoot, pageId) {
|
||||
const safePageId = String(pageId ?? '').trim();
|
||||
if (!safePageId || /[\\/]/.test(safePageId)) {
|
||||
throw Object.assign(new Error('pageId 无效'), { code: 'invalid_page_id' });
|
||||
}
|
||||
return path.join(resolvePageDataLogDir(workspaceRoot), `${safePageId}.jsonl`);
|
||||
}
|
||||
|
||||
export function appendPageDataLog(workspaceRoot, pageId, entry, { maxBytes = DEFAULT_MAX_LOG_BYTES } = {}) {
|
||||
const logPath = resolvePageDataLogPath(workspaceRoot, pageId);
|
||||
fs.mkdirSync(path.dirname(logPath), { recursive: true });
|
||||
const line = `${JSON.stringify({ ...entry, at: entry.at ?? new Date().toISOString() })}\n`;
|
||||
fs.appendFileSync(logPath, line, 'utf8');
|
||||
if (maxBytes > 0 && fs.existsSync(logPath) && fs.statSync(logPath).size > maxBytes) {
|
||||
const raw = fs.readFileSync(logPath, 'utf8').trim().split('\n');
|
||||
const trimmed = raw.slice(-Math.max(50, Math.floor(raw.length / 2)));
|
||||
fs.writeFileSync(logPath, `${trimmed.join('\n')}\n`, 'utf8');
|
||||
}
|
||||
return line;
|
||||
}
|
||||
|
||||
export function listPageDataLogs(workspaceRoot, pageId, { limit = 100, offset = 0 } = {}) {
|
||||
const logPath = resolvePageDataLogPath(workspaceRoot, pageId);
|
||||
if (!fs.existsSync(logPath)) return [];
|
||||
const lines = fs.readFileSync(logPath, 'utf8').trim().split('\n').filter(Boolean);
|
||||
const parsed = lines
|
||||
.map((line) => {
|
||||
try {
|
||||
return JSON.parse(line);
|
||||
} catch {
|
||||
return null;
|
||||
}
|
||||
})
|
||||
.filter(Boolean);
|
||||
const safeOffset = Math.max(0, Number(offset ?? 0));
|
||||
const safeLimit = Math.min(Math.max(1, Number(limit ?? 100)), 500);
|
||||
return parsed.slice(safeOffset, safeOffset + safeLimit);
|
||||
}
|
||||
@@ -0,0 +1,30 @@
|
||||
import assert from 'node:assert/strict';
|
||||
import fs from 'node:fs';
|
||||
import os from 'node:os';
|
||||
import path from 'node:path';
|
||||
import test from 'node:test';
|
||||
import {
|
||||
appendPageDataLog,
|
||||
listPageDataLogs,
|
||||
resolvePageDataLogPath,
|
||||
} from './page-data-log-store.mjs';
|
||||
|
||||
test('appendPageDataLog writes jsonl entries and listPageDataLogs reads them back', () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-log-'));
|
||||
appendPageDataLog(workspaceRoot, 'page-1', {
|
||||
action: 'insert',
|
||||
dataset: 'entries',
|
||||
rowId: 1,
|
||||
});
|
||||
appendPageDataLog(workspaceRoot, 'page-1', {
|
||||
action: 'update',
|
||||
dataset: 'entries',
|
||||
rowId: 1,
|
||||
});
|
||||
assert.equal(fs.existsSync(resolvePageDataLogPath(workspaceRoot, 'page-1')), true);
|
||||
const logs = listPageDataLogs(workspaceRoot, 'page-1');
|
||||
assert.equal(logs.length, 2);
|
||||
assert.equal(logs[0].action, 'insert');
|
||||
assert.equal(logs[1].action, 'update');
|
||||
assert.ok(logs[0].at);
|
||||
});
|
||||
@@ -0,0 +1,226 @@
|
||||
import assert from 'node:assert/strict';
|
||||
import fs from 'node:fs';
|
||||
import os from 'node:os';
|
||||
import path from 'node:path';
|
||||
import test from 'node:test';
|
||||
import express from 'express';
|
||||
import { attachPageDataRoutes } from './page-data-routes.mjs';
|
||||
import { createPageDataService } from './page-data-service.mjs';
|
||||
import { createPageDataPublicService } from './page-data-public-service.mjs';
|
||||
import { createPageDataSessionStore } from './page-data-session-store.mjs';
|
||||
import { createUserDataSpaceService } from './user-data-space-service.mjs';
|
||||
import { writePageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
import { publicationInternals } from './mindspace-publications.mjs';
|
||||
|
||||
const PAGE_ID = 'page-ops-1';
|
||||
const OWNER_ID = 'user-ops-1';
|
||||
const OLD_PASSWORD = 'old-pass-123';
|
||||
const NEW_PASSWORD = 'new-pass-456';
|
||||
|
||||
function createPool({ accessMode = 'password', password = OLD_PASSWORD, onUpdate } = {}) {
|
||||
const passwordHash = password ? publicationInternals.hashPassword(password) : null;
|
||||
const state = {
|
||||
id: 'pub-ops-1',
|
||||
user_id: OWNER_ID,
|
||||
page_id: PAGE_ID,
|
||||
access_mode: accessMode,
|
||||
password_hash: passwordHash,
|
||||
status: 'online',
|
||||
expires_at: null,
|
||||
};
|
||||
return {
|
||||
async query(sql, params) {
|
||||
if (sql.includes('FROM h5_publish_records') && sql.includes('WHERE pr.page_id')) {
|
||||
return [[{ ...state }]];
|
||||
}
|
||||
if (sql.startsWith('UPDATE h5_publish_records SET password_hash')) {
|
||||
state.password_hash = params[0];
|
||||
onUpdate?.(params);
|
||||
return [{ affectedRows: 1 }];
|
||||
}
|
||||
return [[]];
|
||||
},
|
||||
};
|
||||
}
|
||||
|
||||
async function setupWorkspace(workspaceRoot) {
|
||||
const service = createUserDataSpaceService({ workspaceRoot });
|
||||
await service.executeSql(`CREATE TABLE signups (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
name TEXT NOT NULL,
|
||||
phone TEXT,
|
||||
created_at TEXT
|
||||
);`);
|
||||
await service.upsertDataset({
|
||||
name: 'signups',
|
||||
table: 'signups',
|
||||
actions: ['read', 'insert'],
|
||||
columns: {
|
||||
read: ['id', 'name', 'phone', 'created_at'],
|
||||
insert: ['name', 'phone'],
|
||||
},
|
||||
});
|
||||
writePageAccessPolicy(workspaceRoot, {
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
accessMode: 'password',
|
||||
datasets: {
|
||||
signups: {
|
||||
read: true,
|
||||
insert: true,
|
||||
columns: {
|
||||
read: ['id', 'name', 'phone', 'created_at'],
|
||||
insert: ['name', 'phone'],
|
||||
},
|
||||
},
|
||||
},
|
||||
});
|
||||
return service;
|
||||
}
|
||||
|
||||
function buildApp(workspaceRoot, pool, sessionStore) {
|
||||
const pageDataPublicService = createPageDataPublicService({
|
||||
getPool: () => pool,
|
||||
resolveWorkspaceRootForOwner: () => workspaceRoot,
|
||||
sessionStore,
|
||||
});
|
||||
const api = express.Router();
|
||||
api.use(express.json());
|
||||
api.use((req, _res, next) => {
|
||||
if (req.headers['x-test-user']) {
|
||||
req.currentUser = { id: OWNER_ID, workspaceRoot };
|
||||
}
|
||||
next();
|
||||
});
|
||||
attachPageDataRoutes(api, {
|
||||
sendData: (res, _req, data, status = 200) => res.status(status).json({ data }),
|
||||
sendError: (res, _req, status, code, message) => res.status(status).json({ error: { code, message } }),
|
||||
getPageDataService: () =>
|
||||
createPageDataService({
|
||||
resolveWorkspaceRoot: async () => workspaceRoot,
|
||||
}),
|
||||
getPageDataPublicService: () => pageDataPublicService,
|
||||
});
|
||||
const app = express();
|
||||
app.use('/api', api);
|
||||
return app;
|
||||
}
|
||||
|
||||
async function request(app, method, url, { body, headers } = {}) {
|
||||
const server = app.listen(0);
|
||||
try {
|
||||
const { port } = server.address();
|
||||
const response = await fetch(`http://127.0.0.1:${port}${url}`, {
|
||||
method,
|
||||
headers: {
|
||||
...(body ? { 'content-type': 'application/json' } : {}),
|
||||
...headers,
|
||||
},
|
||||
body: body ? JSON.stringify(body) : undefined,
|
||||
});
|
||||
return { status: response.status, body: await response.json() };
|
||||
} finally {
|
||||
await new Promise((resolve) => server.close(resolve));
|
||||
}
|
||||
}
|
||||
|
||||
test('ops overview returns datasets stats logs and active sessions', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-ops-overview-'));
|
||||
const ownerService = await setupWorkspace(workspaceRoot);
|
||||
await ownerService.insertDatasetRow('signups', { name: '概览项', phone: '13800000000' });
|
||||
const sessionStore = createPageDataSessionStore();
|
||||
sessionStore.issue({
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
publicationId: 'pub-ops-1',
|
||||
accessMode: 'password',
|
||||
});
|
||||
const app = buildApp(workspaceRoot, createPool(), sessionStore);
|
||||
|
||||
await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/signups/rows`, {
|
||||
body: { name: '公开提交', phone: '13800000001' },
|
||||
headers: { 'x-page-data-token': (await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data-auth`, { body: { password: OLD_PASSWORD } })).body.data.token },
|
||||
});
|
||||
|
||||
const overview = await request(app, 'GET', `/api/page-data/policies/${PAGE_ID}/ops`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
});
|
||||
assert.equal(overview.status, 200);
|
||||
assert.equal(overview.body.data.datasets.length, 1);
|
||||
assert.equal(overview.body.data.datasets[0].stats.total, 2);
|
||||
assert.ok(overview.body.data.activeSessionCount >= 1);
|
||||
assert.ok(overview.body.data.recentLogs.length >= 1);
|
||||
});
|
||||
|
||||
test('owner can revoke all tokens and reset password', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-ops-reset-'));
|
||||
await setupWorkspace(workspaceRoot);
|
||||
const sessionStore = createPageDataSessionStore();
|
||||
const auth1 = sessionStore.issue({
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
publicationId: 'pub-ops-1',
|
||||
accessMode: 'password',
|
||||
});
|
||||
const auth2 = sessionStore.issue({
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
publicationId: 'pub-ops-1',
|
||||
accessMode: 'password',
|
||||
});
|
||||
let updatedPasswordHash = null;
|
||||
const app = buildApp(workspaceRoot, createPool({ onUpdate: ([hash]) => { updatedPasswordHash = hash; } }), sessionStore);
|
||||
|
||||
const revoked = await request(app, 'POST', `/api/page-data/policies/${PAGE_ID}/tokens/revoke`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
body: { revokeAll: true },
|
||||
});
|
||||
assert.equal(revoked.status, 200);
|
||||
assert.equal(revoked.body.data.revokedCount, 2);
|
||||
assert.equal(sessionStore.verify(auth1.token), null);
|
||||
assert.equal(sessionStore.verify(auth2.token), null);
|
||||
|
||||
const reset = await request(app, 'POST', `/api/page-data/policies/${PAGE_ID}/password/reset`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
body: { password: NEW_PASSWORD },
|
||||
});
|
||||
assert.equal(reset.status, 200);
|
||||
assert.equal(reset.body.data.passwordReset, true);
|
||||
assert.ok(updatedPasswordHash);
|
||||
assert.ok(publicationInternals.verifyPassword(NEW_PASSWORD, updatedPasswordHash));
|
||||
|
||||
const oldAuthDenied = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data-auth`, {
|
||||
body: { password: OLD_PASSWORD },
|
||||
});
|
||||
assert.equal(oldAuthDenied.status, 401);
|
||||
|
||||
const newAuth = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data-auth`, {
|
||||
body: { password: NEW_PASSWORD },
|
||||
});
|
||||
assert.equal(newAuth.status, 200);
|
||||
assert.ok(newAuth.body.data.token);
|
||||
});
|
||||
|
||||
test('owner can close dataset and public insert is denied afterwards', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-ops-close-'));
|
||||
await setupWorkspace(workspaceRoot);
|
||||
const sessionStore = createPageDataSessionStore();
|
||||
const app = buildApp(workspaceRoot, createPool(), sessionStore);
|
||||
const auth = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data-auth`, {
|
||||
body: { password: OLD_PASSWORD },
|
||||
});
|
||||
|
||||
const closed = await request(app, 'POST', `/api/page-data/policies/${PAGE_ID}/datasets/signups/close`, {
|
||||
headers: { 'x-test-user': '1' },
|
||||
});
|
||||
assert.equal(closed.status, 200);
|
||||
assert.equal(closed.body.data.closed, true);
|
||||
assert.equal(closed.body.data.policyDataset.closed, true);
|
||||
|
||||
const denied = await request(app, 'POST', `/api/public/pages/${PAGE_ID}/data/signups/rows`, {
|
||||
headers: { 'x-page-data-token': auth.body.data.token },
|
||||
body: { name: '关闭后提交', phone: '13800000002' },
|
||||
});
|
||||
assert.equal(denied.status, 403);
|
||||
assert.equal(denied.body.error.code, 'action_not_allowed');
|
||||
});
|
||||
@@ -0,0 +1,90 @@
|
||||
import crypto from 'node:crypto';
|
||||
|
||||
export function buildPageDataPolicyScopeHash(policy) {
|
||||
const payload = {
|
||||
accessMode: policy?.accessMode ?? null,
|
||||
datasets: Object.keys(policy?.datasets ?? {}).sort(),
|
||||
};
|
||||
return crypto.createHash('sha256').update(JSON.stringify(payload)).digest('hex').slice(0, 16);
|
||||
}
|
||||
|
||||
export async function upsertPageDataPolicyIndex(pool, policy) {
|
||||
if (!pool || !policy?.pageId || !policy?.ownerUserId) return null;
|
||||
const datasetCount = Object.keys(policy.datasets ?? {}).length;
|
||||
const now = Date.now();
|
||||
await pool.query(
|
||||
`INSERT INTO h5_page_data_policy_index
|
||||
(page_id, owner_user_id, access_mode, dataset_count, scope_hash, updated_at)
|
||||
VALUES (?, ?, ?, ?, ?, ?)
|
||||
ON DUPLICATE KEY UPDATE
|
||||
owner_user_id = VALUES(owner_user_id),
|
||||
access_mode = VALUES(access_mode),
|
||||
dataset_count = VALUES(dataset_count),
|
||||
scope_hash = VALUES(scope_hash),
|
||||
updated_at = VALUES(updated_at)`,
|
||||
[
|
||||
policy.pageId,
|
||||
policy.ownerUserId,
|
||||
policy.accessMode,
|
||||
datasetCount,
|
||||
buildPageDataPolicyScopeHash(policy),
|
||||
now,
|
||||
],
|
||||
);
|
||||
return {
|
||||
pageId: policy.pageId,
|
||||
ownerUserId: policy.ownerUserId,
|
||||
accessMode: policy.accessMode,
|
||||
datasetCount,
|
||||
scopeHash: buildPageDataPolicyScopeHash(policy),
|
||||
updatedAt: now,
|
||||
};
|
||||
}
|
||||
|
||||
export async function getPageDataPolicyIndex(pool, pageId) {
|
||||
if (!pool) return null;
|
||||
const [rows] = await pool.query(
|
||||
`SELECT page_id, owner_user_id, access_mode, dataset_count, scope_hash, updated_at
|
||||
FROM h5_page_data_policy_index
|
||||
WHERE page_id = ?
|
||||
LIMIT 1`,
|
||||
[pageId],
|
||||
);
|
||||
const row = rows[0];
|
||||
if (!row) return null;
|
||||
return {
|
||||
pageId: row.page_id,
|
||||
ownerUserId: row.owner_user_id,
|
||||
accessMode: row.access_mode,
|
||||
datasetCount: Number(row.dataset_count ?? 0),
|
||||
scopeHash: row.scope_hash,
|
||||
updatedAt: Number(row.updated_at ?? 0),
|
||||
};
|
||||
}
|
||||
|
||||
export async function listPageDataPolicyIndexByOwner(pool, ownerUserId, { limit = 50 } = {}) {
|
||||
if (!pool) return [];
|
||||
const safeLimit = Math.min(Math.max(1, Number(limit ?? 50)), 200);
|
||||
const [rows] = await pool.query(
|
||||
`SELECT page_id, owner_user_id, access_mode, dataset_count, scope_hash, updated_at
|
||||
FROM h5_page_data_policy_index
|
||||
WHERE owner_user_id = ?
|
||||
ORDER BY updated_at DESC
|
||||
LIMIT ?`,
|
||||
[ownerUserId, safeLimit],
|
||||
);
|
||||
return rows.map((row) => ({
|
||||
pageId: row.page_id,
|
||||
ownerUserId: row.owner_user_id,
|
||||
accessMode: row.access_mode,
|
||||
datasetCount: Number(row.dataset_count ?? 0),
|
||||
scopeHash: row.scope_hash,
|
||||
updatedAt: Number(row.updated_at ?? 0),
|
||||
}));
|
||||
}
|
||||
|
||||
export async function deletePageDataPolicyIndex(pool, pageId) {
|
||||
if (!pool || !pageId) return false;
|
||||
const [result] = await pool.query(`DELETE FROM h5_page_data_policy_index WHERE page_id = ?`, [pageId]);
|
||||
return Number(result?.affectedRows ?? 0) > 0;
|
||||
}
|
||||
@@ -0,0 +1,60 @@
|
||||
import assert from 'node:assert/strict';
|
||||
import test from 'node:test';
|
||||
import {
|
||||
buildPageDataPolicyScopeHash,
|
||||
upsertPageDataPolicyIndex,
|
||||
} from './page-data-policy-index.mjs';
|
||||
import {
|
||||
mapPublicationAccessModeToPageData,
|
||||
syncPageDataPolicyAccessMode,
|
||||
} from './page-data-publish-sync.mjs';
|
||||
import { writePageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
import fs from 'node:fs';
|
||||
import os from 'node:os';
|
||||
import path from 'node:path';
|
||||
|
||||
test('buildPageDataPolicyScopeHash is stable for same policy shape', () => {
|
||||
const policy = {
|
||||
accessMode: 'public',
|
||||
datasets: { signups: { insert: true }, leads: { insert: true } },
|
||||
};
|
||||
assert.equal(
|
||||
buildPageDataPolicyScopeHash(policy),
|
||||
buildPageDataPolicyScopeHash({
|
||||
accessMode: 'public',
|
||||
datasets: { leads: { insert: true }, signups: { insert: true } },
|
||||
}),
|
||||
);
|
||||
});
|
||||
|
||||
test('upsertPageDataPolicyIndex writes mysql row', async () => {
|
||||
const queries = [];
|
||||
const pool = {
|
||||
async query(sql, params) {
|
||||
queries.push({ sql, params });
|
||||
return [{ affectedRows: 1 }];
|
||||
},
|
||||
};
|
||||
const result = await upsertPageDataPolicyIndex(pool, {
|
||||
pageId: 'page-1',
|
||||
ownerUserId: 'user-1',
|
||||
accessMode: 'password',
|
||||
datasets: { signups: { insert: true } },
|
||||
});
|
||||
assert.equal(result.datasetCount, 1);
|
||||
assert.match(queries[0].sql, /h5_page_data_policy_index/);
|
||||
assert.equal(queries[0].params[0], 'page-1');
|
||||
});
|
||||
|
||||
test('syncPageDataPolicyAccessMode updates policy access mode after publish', () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-publish-sync-'));
|
||||
writePageAccessPolicy(workspaceRoot, {
|
||||
pageId: 'page-1',
|
||||
ownerUserId: 'user-1',
|
||||
accessMode: 'public',
|
||||
datasets: { signups: { insert: true, columns: { insert: ['name'] } } },
|
||||
});
|
||||
const synced = syncPageDataPolicyAccessMode(workspaceRoot, 'page-1', 'password', 'user-1');
|
||||
assert.equal(synced?.accessMode, 'password');
|
||||
assert.equal(mapPublicationAccessModeToPageData('private_link'), null);
|
||||
});
|
||||
+442
-26
@@ -2,15 +2,35 @@ import { resolveMindSpaceUserPublishDir } from './mindspace-runtime-config.mjs';
|
||||
import { publicationInternals } from './mindspace-publications.mjs';
|
||||
import {
|
||||
buildEffectiveDataset,
|
||||
buildPageDataPolicyFromPublishInput,
|
||||
closePolicyDataset,
|
||||
normalizePageAccessPolicy,
|
||||
policyAllowsAction,
|
||||
} from './page-access-policy.mjs';
|
||||
import {
|
||||
extractPageDataCaptchaToken,
|
||||
stripPageDataMetaFields,
|
||||
verifyPageDataCaptcha,
|
||||
} from './page-data-captcha.mjs';
|
||||
import {
|
||||
buildEffectiveDatasetForRole,
|
||||
resolveRowAccessScope,
|
||||
resolveRolePermissions,
|
||||
resolveVisitorRole,
|
||||
roleAllowsAction,
|
||||
} from './page-access-visitor.mjs';
|
||||
import { readPageAccessPolicy, writePageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
import {
|
||||
createPageDataRateLimiter,
|
||||
createPageDataSessionStore,
|
||||
hashClientMeta,
|
||||
} from './page-data-session-store.mjs';
|
||||
import { appendPageDataLog, listPageDataLogs } from './page-data-log-store.mjs';
|
||||
import {
|
||||
getPageDataPolicyIndex,
|
||||
listPageDataPolicyIndexByOwner,
|
||||
upsertPageDataPolicyIndex,
|
||||
} from './page-data-policy-index.mjs';
|
||||
import { createUserDataSpaceService } from './user-data-space-service.mjs';
|
||||
|
||||
function mapPublicError(error) {
|
||||
@@ -45,12 +65,18 @@ function mapPublicError(error) {
|
||||
if (code === 'forbidden') {
|
||||
return { status: 403, code: 'forbidden', message: error.message };
|
||||
}
|
||||
if (code === 'row_not_allowed' || code === 'row_policy_invalid') {
|
||||
return { status: 403, code: code ?? 'row_not_allowed', message: error.message };
|
||||
}
|
||||
if (code === 'unauthorized') {
|
||||
return { status: 401, code: 'unauthorized', message: error.message };
|
||||
}
|
||||
if (code === 'invalid_payload' || code === 'payload_too_large' || code === 'invalid_policy') {
|
||||
return { status: 400, code: code ?? 'invalid_request', message: error.message };
|
||||
}
|
||||
if (code === 'captcha_required' || code === 'captcha_invalid') {
|
||||
return { status: error.status ?? 400, code, message: error.message };
|
||||
}
|
||||
return {
|
||||
status: 400,
|
||||
code: 'page_data_failed',
|
||||
@@ -145,7 +171,7 @@ export function createPageDataPublicService(deps = {}) {
|
||||
});
|
||||
}
|
||||
|
||||
function resolveEffectiveDataset(ownerUserId, policy, datasetName) {
|
||||
function resolveEffectiveDataset(ownerUserId, policy, datasetName, rolePermissions = null) {
|
||||
const policyDataset = policy.datasets?.[datasetName];
|
||||
if (!policyDataset) {
|
||||
throw Object.assign(new Error('dataset 未授权'), { code: 'action_not_allowed' });
|
||||
@@ -155,11 +181,24 @@ export function createPageDataPublicService(deps = {}) {
|
||||
if (!registryDataset) {
|
||||
throw Object.assign(new Error('dataset 不存在'), { code: 'dataset_not_found' });
|
||||
}
|
||||
const effective = buildEffectiveDataset(registryDataset, policyDataset);
|
||||
const effective = rolePermissions
|
||||
? buildEffectiveDatasetForRole(registryDataset, policyDataset, rolePermissions)
|
||||
: buildEffectiveDataset(registryDataset, policyDataset);
|
||||
if (!effective) {
|
||||
throw Object.assign(new Error('dataset 未授权'), { code: 'action_not_allowed' });
|
||||
}
|
||||
return { ownerService, effective };
|
||||
return { ownerService, effective, policyDataset };
|
||||
}
|
||||
|
||||
function resolveRowScope(ownerService, effective, policyDataset, visitorContext) {
|
||||
if (!policyDataset?.rowPolicy || !visitorContext) return null;
|
||||
const tableColumns = ownerService.listTableColumns(effective.table);
|
||||
return resolveRowAccessScope(policyDataset.rowPolicy, {
|
||||
visitorRole: visitorContext.visitorRole,
|
||||
visitorUserId: visitorContext.visitorUserId,
|
||||
ownerUserId: visitorContext.ownerUserId,
|
||||
tableColumns,
|
||||
});
|
||||
}
|
||||
|
||||
function enforceRateLimit(req, publication, action) {
|
||||
@@ -198,10 +237,24 @@ export function createPageDataPublicService(deps = {}) {
|
||||
if (!viewerId) {
|
||||
throw Object.assign(new Error('需要登录后才能访问页面数据'), { code: 'auth_required' });
|
||||
}
|
||||
const visitorRole = resolveVisitorRole(policy, viewerId);
|
||||
if (!visitorRole) {
|
||||
throw Object.assign(new Error('当前账号未被授权访问此页面数据'), { code: 'forbidden' });
|
||||
}
|
||||
const rolePermissions = resolveRolePermissions(policy, visitorRole);
|
||||
if (!policyAllowsAction(policy, datasetName, action)) {
|
||||
throw Object.assign(new Error(`dataset 未授权 ${action}`), { code: 'action_not_allowed' });
|
||||
}
|
||||
return { accessMode, session: { sessionId: viewerId, ownerUserId: publication.user_id } };
|
||||
if (!roleAllowsAction(rolePermissions, action)) {
|
||||
throw Object.assign(new Error(`当前角色未授权 ${action}`), { code: 'action_not_allowed' });
|
||||
}
|
||||
return {
|
||||
accessMode,
|
||||
session: { sessionId: viewerId, ownerUserId: publication.user_id, visitorUserId: viewerId },
|
||||
visitorRole,
|
||||
rolePermissions,
|
||||
ownerUserId: publication.user_id,
|
||||
};
|
||||
}
|
||||
|
||||
throw Object.assign(new Error('当前页面访问模式不支持 Page Data API'), { code: 'action_not_allowed' });
|
||||
@@ -242,10 +295,27 @@ export function createPageDataPublicService(deps = {}) {
|
||||
return runPublicAction(async () => {
|
||||
const publication = await queryPublication(pageId);
|
||||
const policy = await loadPolicy(publication);
|
||||
resolveAccessContext({ publication, policy, req, action: 'read', datasetName });
|
||||
const access = resolveAccessContext({ publication, policy, req, action: 'read', datasetName });
|
||||
enforceRateLimit(req, publication, 'read');
|
||||
const { ownerService, effective } = resolveEffectiveDataset(publication.user_id, policy, datasetName);
|
||||
return ownerService.readRowsForDataset(effective, query);
|
||||
const { ownerService, effective, policyDataset } = resolveEffectiveDataset(
|
||||
publication.user_id,
|
||||
policy,
|
||||
datasetName,
|
||||
access.rolePermissions ?? null,
|
||||
);
|
||||
const rowScope = resolveRowScope(
|
||||
ownerService,
|
||||
effective,
|
||||
policyDataset,
|
||||
access.accessMode === 'login_required'
|
||||
? {
|
||||
visitorRole: access.visitorRole,
|
||||
visitorUserId: access.session?.visitorUserId,
|
||||
ownerUserId: access.ownerUserId,
|
||||
}
|
||||
: null,
|
||||
);
|
||||
return ownerService.readRowsForDataset(effective, { ...query, rowScope });
|
||||
});
|
||||
}
|
||||
|
||||
@@ -253,8 +323,13 @@ export function createPageDataPublicService(deps = {}) {
|
||||
return runPublicAction(async () => {
|
||||
const publication = await queryPublication(pageId);
|
||||
const policy = await loadPolicy(publication);
|
||||
resolveAccessContext({ publication, policy, req, action: 'read', datasetName });
|
||||
const { ownerService, effective } = resolveEffectiveDataset(publication.user_id, policy, datasetName);
|
||||
const access = resolveAccessContext({ publication, policy, req, action: 'read', datasetName });
|
||||
const { ownerService, effective } = resolveEffectiveDataset(
|
||||
publication.user_id,
|
||||
policy,
|
||||
datasetName,
|
||||
access.rolePermissions ?? null,
|
||||
);
|
||||
return ownerService.getSchemaForDataset(effective);
|
||||
});
|
||||
}
|
||||
@@ -263,30 +338,112 @@ export function createPageDataPublicService(deps = {}) {
|
||||
return runPublicAction(async () => {
|
||||
const publication = await queryPublication(pageId);
|
||||
const policy = await loadPolicy(publication);
|
||||
resolveAccessContext({ publication, policy, req, action: 'read', datasetName });
|
||||
const { ownerService, effective } = resolveEffectiveDataset(publication.user_id, policy, datasetName);
|
||||
return ownerService.getStatsForDataset(effective);
|
||||
const access = resolveAccessContext({ publication, policy, req, action: 'read', datasetName });
|
||||
const { ownerService, effective, policyDataset } = resolveEffectiveDataset(
|
||||
publication.user_id,
|
||||
policy,
|
||||
datasetName,
|
||||
access.rolePermissions ?? null,
|
||||
);
|
||||
const rowScope = resolveRowScope(
|
||||
ownerService,
|
||||
effective,
|
||||
policyDataset,
|
||||
access.accessMode === 'login_required'
|
||||
? {
|
||||
visitorRole: access.visitorRole,
|
||||
visitorUserId: access.session?.visitorUserId,
|
||||
ownerUserId: access.ownerUserId,
|
||||
}
|
||||
: null,
|
||||
);
|
||||
return ownerService.getStatsForDataset(effective, { rowScope });
|
||||
});
|
||||
}
|
||||
|
||||
async function insertRow(pageId, datasetName, req, payload) {
|
||||
function recordPublicLog(workspaceRoot, publication, {
|
||||
datasetName,
|
||||
action,
|
||||
rowId,
|
||||
req,
|
||||
session,
|
||||
accessMode,
|
||||
visitorRole,
|
||||
summary,
|
||||
}) {
|
||||
appendPageDataLog(workspaceRoot, publication.page_id, {
|
||||
pageId: publication.page_id,
|
||||
dataset: datasetName,
|
||||
action,
|
||||
rowId: rowId ?? null,
|
||||
accessMode,
|
||||
actor: {
|
||||
type: accessMode === 'public' ? 'anonymous' : accessMode,
|
||||
userId: req.currentUser?.id ?? session?.visitorUserId ?? null,
|
||||
visitorUserId: session?.visitorUserId ?? req.currentUser?.id ?? null,
|
||||
role: visitorRole ?? null,
|
||||
sessionId: session?.sessionId ?? null,
|
||||
ipHash: hashClientMeta(req.ip ?? req.socket?.remoteAddress),
|
||||
userAgentHash: hashClientMeta(req.headers?.['user-agent']),
|
||||
},
|
||||
summary: summary ?? null,
|
||||
});
|
||||
}
|
||||
|
||||
async function insertRow(pageId, datasetName, req, payloadInput) {
|
||||
return runPublicAction(async () => {
|
||||
const publication = await queryPublication(pageId);
|
||||
const policy = await loadPolicy(publication);
|
||||
const { session } = resolveAccessContext({
|
||||
const access = resolveAccessContext({
|
||||
publication,
|
||||
policy,
|
||||
req,
|
||||
action: 'insert',
|
||||
datasetName,
|
||||
});
|
||||
if (access.accessMode === 'public') {
|
||||
await verifyPageDataCaptcha(
|
||||
extractPageDataCaptchaToken(req, payloadInput),
|
||||
req.ip ?? req.socket?.remoteAddress,
|
||||
);
|
||||
}
|
||||
const payload = stripPageDataMetaFields(payloadInput);
|
||||
enforceRateLimit(req, publication, 'insert');
|
||||
const { ownerService, effective } = resolveEffectiveDataset(publication.user_id, policy, datasetName);
|
||||
return ownerService.insertRowForDataset(effective, payload, {
|
||||
const { ownerService, effective, policyDataset } = resolveEffectiveDataset(
|
||||
publication.user_id,
|
||||
policy,
|
||||
datasetName,
|
||||
access.rolePermissions ?? null,
|
||||
);
|
||||
const rowScope = resolveRowScope(
|
||||
ownerService,
|
||||
effective,
|
||||
policyDataset,
|
||||
access.accessMode === 'login_required'
|
||||
? {
|
||||
visitorRole: access.visitorRole,
|
||||
visitorUserId: access.session?.visitorUserId,
|
||||
ownerUserId: access.ownerUserId,
|
||||
}
|
||||
: null,
|
||||
);
|
||||
const result = await ownerService.insertRowForDataset(effective, payload, {
|
||||
createdIpHash: hashClientMeta(req.ip ?? req.socket?.remoteAddress),
|
||||
userAgentHash: hashClientMeta(req.headers?.['user-agent']),
|
||||
pageDataSessionId: session?.sessionId ?? null,
|
||||
pageDataSessionId: access.session?.sessionId ?? null,
|
||||
rowScope,
|
||||
});
|
||||
recordPublicLog(resolveWorkspaceRoot(publication.user_id), publication, {
|
||||
datasetName,
|
||||
action: 'insert',
|
||||
rowId: result.row?.id ?? null,
|
||||
req,
|
||||
session: access.session,
|
||||
accessMode: access.accessMode,
|
||||
visitorRole: access.visitorRole,
|
||||
summary: { fields: Object.keys(payload ?? {}) },
|
||||
});
|
||||
return result;
|
||||
});
|
||||
}
|
||||
|
||||
@@ -294,7 +451,7 @@ export function createPageDataPublicService(deps = {}) {
|
||||
return runPublicAction(async () => {
|
||||
const publication = await queryPublication(pageId);
|
||||
const policy = await loadPolicy(publication);
|
||||
const { session } = resolveAccessContext({
|
||||
const access = resolveAccessContext({
|
||||
publication,
|
||||
policy,
|
||||
req,
|
||||
@@ -302,10 +459,39 @@ export function createPageDataPublicService(deps = {}) {
|
||||
datasetName,
|
||||
});
|
||||
enforceRateLimit(req, publication, 'update');
|
||||
const { ownerService, effective } = resolveEffectiveDataset(publication.user_id, policy, datasetName);
|
||||
return ownerService.updateRowForDataset(effective, rowId, payload, {
|
||||
updatedByLabel: req.body?.updated_by_label ?? session?.sessionId ?? 'public',
|
||||
const { ownerService, effective, policyDataset } = resolveEffectiveDataset(
|
||||
publication.user_id,
|
||||
policy,
|
||||
datasetName,
|
||||
access.rolePermissions ?? null,
|
||||
);
|
||||
const rowScope = resolveRowScope(
|
||||
ownerService,
|
||||
effective,
|
||||
policyDataset,
|
||||
access.accessMode === 'login_required'
|
||||
? {
|
||||
visitorRole: access.visitorRole,
|
||||
visitorUserId: access.session?.visitorUserId,
|
||||
ownerUserId: access.ownerUserId,
|
||||
}
|
||||
: null,
|
||||
);
|
||||
const result = await ownerService.updateRowForDataset(effective, rowId, payload, {
|
||||
updatedByLabel: req.body?.updated_by_label ?? access.session?.sessionId ?? 'public',
|
||||
rowScope,
|
||||
});
|
||||
recordPublicLog(resolveWorkspaceRoot(publication.user_id), publication, {
|
||||
datasetName,
|
||||
action: 'update',
|
||||
rowId,
|
||||
req,
|
||||
session: access.session,
|
||||
accessMode: access.accessMode,
|
||||
visitorRole: access.visitorRole,
|
||||
summary: { fields: Object.keys(payload ?? {}) },
|
||||
});
|
||||
return result;
|
||||
});
|
||||
}
|
||||
|
||||
@@ -313,7 +499,7 @@ export function createPageDataPublicService(deps = {}) {
|
||||
return runPublicAction(async () => {
|
||||
const publication = await queryPublication(pageId);
|
||||
const policy = await loadPolicy(publication);
|
||||
const { session } = resolveAccessContext({
|
||||
const access = resolveAccessContext({
|
||||
publication,
|
||||
policy,
|
||||
req,
|
||||
@@ -321,13 +507,48 @@ export function createPageDataPublicService(deps = {}) {
|
||||
datasetName,
|
||||
});
|
||||
enforceRateLimit(req, publication, 'soft_delete');
|
||||
const { ownerService, effective } = resolveEffectiveDataset(publication.user_id, policy, datasetName);
|
||||
return ownerService.softDeleteRowForDataset(effective, rowId, {
|
||||
deletedBy: session?.sessionId ?? 'public',
|
||||
const { ownerService, effective, policyDataset } = resolveEffectiveDataset(
|
||||
publication.user_id,
|
||||
policy,
|
||||
datasetName,
|
||||
access.rolePermissions ?? null,
|
||||
);
|
||||
const rowScope = resolveRowScope(
|
||||
ownerService,
|
||||
effective,
|
||||
policyDataset,
|
||||
access.accessMode === 'login_required'
|
||||
? {
|
||||
visitorRole: access.visitorRole,
|
||||
visitorUserId: access.session?.visitorUserId,
|
||||
ownerUserId: access.ownerUserId,
|
||||
}
|
||||
: null,
|
||||
);
|
||||
const result = await ownerService.softDeleteRowForDataset(effective, rowId, {
|
||||
deletedBy: access.session?.sessionId ?? 'public',
|
||||
rowScope,
|
||||
});
|
||||
recordPublicLog(resolveWorkspaceRoot(publication.user_id), publication, {
|
||||
datasetName,
|
||||
action: 'soft_delete',
|
||||
rowId,
|
||||
req,
|
||||
session: access.session,
|
||||
accessMode: access.accessMode,
|
||||
visitorRole: access.visitorRole,
|
||||
summary: null,
|
||||
});
|
||||
return result;
|
||||
});
|
||||
}
|
||||
|
||||
function syncPolicyIndex(policy) {
|
||||
const pool = getPool();
|
||||
if (!pool || !policy) return null;
|
||||
return upsertPageDataPolicyIndex(pool, policy).catch(() => null);
|
||||
}
|
||||
|
||||
async function getOwnerPolicy(user, pageId) {
|
||||
if (!user?.id) throw Object.assign(new Error('未授权'), { code: 'unauthorized', status: 401 });
|
||||
const workspaceRoot = user.workspaceRoot ?? resolveWorkspaceRoot(user.id);
|
||||
@@ -355,7 +576,196 @@ export function createPageDataPublicService(deps = {}) {
|
||||
},
|
||||
{ fallbackPageId: pageId, fallbackOwnerUserId: user.id },
|
||||
);
|
||||
return writePageAccessPolicy(workspaceRoot, policy);
|
||||
const saved = writePageAccessPolicy(workspaceRoot, policy);
|
||||
await syncPolicyIndex(saved);
|
||||
return saved;
|
||||
}
|
||||
|
||||
async function saveOwnerPolicyFromPublish(user, pageId, { datasetName, capabilities = {} } = {}) {
|
||||
if (!user?.id) throw Object.assign(new Error('未授权'), { code: 'unauthorized', status: 401 });
|
||||
const publication = await queryPublication(pageId).catch(() => null);
|
||||
if (!publication || publication.user_id !== user.id) {
|
||||
throw Object.assign(new Error('页面不存在或未发布'), { code: 'publication_not_found', status: 404 });
|
||||
}
|
||||
const normalizedDatasetName = String(datasetName ?? '').trim();
|
||||
if (!normalizedDatasetName) {
|
||||
throw Object.assign(new Error('缺少 dataset 名称'), { code: 'invalid_request', status: 400 });
|
||||
}
|
||||
const ownerService = createOwnerService(user.id);
|
||||
const registryDataset = ownerService.getDataset(normalizedDatasetName);
|
||||
if (!registryDataset) {
|
||||
throw Object.assign(new Error('dataset 未注册'), { code: 'dataset_not_found', status: 404 });
|
||||
}
|
||||
const workspaceRoot = user.workspaceRoot ?? resolveWorkspaceRoot(user.id);
|
||||
const policy = buildPageDataPolicyFromPublishInput({
|
||||
pageId,
|
||||
ownerUserId: user.id,
|
||||
accessMode: publication.access_mode,
|
||||
datasetName: registryDataset.name,
|
||||
registryDataset,
|
||||
capabilities,
|
||||
});
|
||||
const saved = writePageAccessPolicy(workspaceRoot, policy);
|
||||
await syncPolicyIndex(saved);
|
||||
return saved;
|
||||
}
|
||||
|
||||
async function listOwnerPolicies(user) {
|
||||
if (!user?.id) throw Object.assign(new Error('未授权'), { code: 'unauthorized', status: 401 });
|
||||
const pool = getPool();
|
||||
if (!pool) return [];
|
||||
return listPageDataPolicyIndexByOwner(pool, user.id);
|
||||
}
|
||||
|
||||
async function getPageOpsOverview(user, pageId) {
|
||||
if (!user?.id) throw Object.assign(new Error('未授权'), { code: 'unauthorized', status: 401 });
|
||||
const publication = await queryPublication(pageId);
|
||||
if (publication.user_id !== user.id) {
|
||||
throw Object.assign(new Error('无权访问该页面运维信息'), { code: 'forbidden', status: 403 });
|
||||
}
|
||||
const workspaceRoot = user.workspaceRoot ?? resolveWorkspaceRoot(user.id);
|
||||
const policy = readPageAccessPolicy(workspaceRoot, pageId);
|
||||
if (!policy) {
|
||||
throw Object.assign(new Error('页面数据策略未配置'), { code: 'policy_not_found', status: 404 });
|
||||
}
|
||||
const ownerService = createOwnerService(user.id);
|
||||
const datasets = [];
|
||||
for (const [name, config] of Object.entries(policy.datasets ?? {})) {
|
||||
let stats = null;
|
||||
try {
|
||||
if (ownerService.getDataset(name)) {
|
||||
stats = ownerService.getDatasetStats(name);
|
||||
}
|
||||
} catch {
|
||||
stats = null;
|
||||
}
|
||||
datasets.push({
|
||||
name,
|
||||
read: config.read,
|
||||
insert: config.insert,
|
||||
update: config.update,
|
||||
softDelete: config.softDelete,
|
||||
closed: Boolean(config.closed),
|
||||
closedAt: config.closedAt ?? null,
|
||||
stats,
|
||||
});
|
||||
}
|
||||
const logs = listPageDataLogs(workspaceRoot, pageId, { limit: 50, offset: 0 });
|
||||
const recentSubmissions = logs.filter((entry) => entry.action === 'insert').slice(0, 10);
|
||||
const activeSessions = sessionStore.listByPageId(pageId);
|
||||
const index = await getPageDataPolicyIndex(getPool(), pageId);
|
||||
const registeredDatasets = ownerService.listDatasets().map((dataset) => dataset.name);
|
||||
const configuredNames = new Set(Object.keys(policy.datasets ?? {}));
|
||||
const unconfiguredDatasets = registeredDatasets.filter((name) => !configuredNames.has(name));
|
||||
return {
|
||||
pageId,
|
||||
publication: {
|
||||
id: publication.id,
|
||||
pageId: publication.page_id,
|
||||
accessMode: publication.access_mode,
|
||||
status: publication.status,
|
||||
},
|
||||
policy,
|
||||
index,
|
||||
registeredDatasets,
|
||||
unconfiguredDatasets,
|
||||
datasets,
|
||||
recentLogs: logs.slice(0, 20),
|
||||
recentSubmissions,
|
||||
activeSessionCount: activeSessions.length,
|
||||
activeSessions,
|
||||
};
|
||||
}
|
||||
|
||||
async function revokePageDataTokens(user, pageId, { token = null, revokeAll = false } = {}) {
|
||||
if (!user?.id) throw Object.assign(new Error('未授权'), { code: 'unauthorized', status: 401 });
|
||||
const publication = await queryPublication(pageId);
|
||||
if (publication.user_id !== user.id) {
|
||||
throw Object.assign(new Error('无权撤销该页面令牌'), { code: 'forbidden', status: 403 });
|
||||
}
|
||||
let revokedCount = 0;
|
||||
if (revokeAll) {
|
||||
revokedCount = sessionStore.revokeByPageId(pageId);
|
||||
} else if (token) {
|
||||
revokedCount = sessionStore.revoke(token) ? 1 : 0;
|
||||
} else {
|
||||
throw Object.assign(new Error('请提供 token 或设置 revokeAll'), { code: 'invalid_request', status: 400 });
|
||||
}
|
||||
const workspaceRoot = user.workspaceRoot ?? resolveWorkspaceRoot(user.id);
|
||||
appendPageDataLog(workspaceRoot, pageId, {
|
||||
pageId,
|
||||
action: 'revoke_tokens',
|
||||
dataset: null,
|
||||
rowId: null,
|
||||
accessMode: publication.access_mode,
|
||||
actor: { type: 'owner', userId: user.id, role: 'owner' },
|
||||
summary: { revokedCount, revokeAll: Boolean(revokeAll) },
|
||||
});
|
||||
return { pageId, revokedCount, revokeAll: Boolean(revokeAll) };
|
||||
}
|
||||
|
||||
async function resetPageDataPassword(user, pageId, password) {
|
||||
if (!user?.id) throw Object.assign(new Error('未授权'), { code: 'unauthorized', status: 401 });
|
||||
const publication = await queryPublication(pageId);
|
||||
if (publication.user_id !== user.id) {
|
||||
throw Object.assign(new Error('无权重置该页面口令'), { code: 'forbidden', status: 403 });
|
||||
}
|
||||
if (publication.access_mode !== 'password') {
|
||||
throw Object.assign(new Error('当前页面不是口令访问模式'), { code: 'auth_not_required', status: 400 });
|
||||
}
|
||||
const normalizedPassword = publicationInternals.normalizePassword(password, true);
|
||||
const passwordHash = publicationInternals.hashPassword(normalizedPassword);
|
||||
const pool = getPool();
|
||||
if (!pool) {
|
||||
throw Object.assign(new Error('数据库未配置'), { code: 'feature_disabled', status: 503 });
|
||||
}
|
||||
await pool.query(
|
||||
`UPDATE h5_publish_records SET password_hash = ?, updated_at = ? WHERE id = ? AND user_id = ?`,
|
||||
[passwordHash, Date.now(), publication.id, user.id],
|
||||
);
|
||||
const revokedCount = sessionStore.revokeByPageId(pageId);
|
||||
const workspaceRoot = user.workspaceRoot ?? resolveWorkspaceRoot(user.id);
|
||||
appendPageDataLog(workspaceRoot, pageId, {
|
||||
pageId,
|
||||
action: 'password_reset',
|
||||
dataset: null,
|
||||
rowId: null,
|
||||
accessMode: publication.access_mode,
|
||||
actor: { type: 'owner', userId: user.id, role: 'owner' },
|
||||
summary: { revokedSessions: revokedCount },
|
||||
});
|
||||
return { pageId, passwordReset: true, revokedSessions: revokedCount };
|
||||
}
|
||||
|
||||
async function closePageDataset(user, pageId, datasetName) {
|
||||
if (!user?.id) throw Object.assign(new Error('未授权'), { code: 'unauthorized', status: 401 });
|
||||
const publication = await queryPublication(pageId);
|
||||
if (publication.user_id !== user.id) {
|
||||
throw Object.assign(new Error('无权关闭该页面 dataset'), { code: 'forbidden', status: 403 });
|
||||
}
|
||||
const workspaceRoot = user.workspaceRoot ?? resolveWorkspaceRoot(user.id);
|
||||
const policy = readPageAccessPolicy(workspaceRoot, pageId);
|
||||
if (!policy) {
|
||||
throw Object.assign(new Error('页面数据策略未配置'), { code: 'policy_not_found', status: 404 });
|
||||
}
|
||||
const closedPolicy = closePolicyDataset(policy, datasetName);
|
||||
const saved = writePageAccessPolicy(workspaceRoot, closedPolicy);
|
||||
await syncPolicyIndex(saved);
|
||||
appendPageDataLog(workspaceRoot, pageId, {
|
||||
pageId,
|
||||
action: 'close_dataset',
|
||||
dataset: datasetName,
|
||||
rowId: null,
|
||||
accessMode: publication.access_mode,
|
||||
actor: { type: 'owner', userId: user.id, role: 'owner' },
|
||||
summary: null,
|
||||
});
|
||||
return {
|
||||
pageId,
|
||||
dataset: datasetName,
|
||||
closed: true,
|
||||
policyDataset: saved.datasets[datasetName],
|
||||
};
|
||||
}
|
||||
|
||||
return {
|
||||
@@ -368,6 +778,12 @@ export function createPageDataPublicService(deps = {}) {
|
||||
softDeleteRow,
|
||||
getOwnerPolicy,
|
||||
saveOwnerPolicy,
|
||||
saveOwnerPolicyFromPublish,
|
||||
listOwnerPolicies,
|
||||
getPageOpsOverview,
|
||||
revokePageDataTokens,
|
||||
resetPageDataPassword,
|
||||
closePageDataset,
|
||||
queryPublication,
|
||||
};
|
||||
}
|
||||
|
||||
@@ -5,7 +5,7 @@ import path from 'node:path';
|
||||
import test from 'node:test';
|
||||
import { createPageDataPublicService, isPageDataPublicPath } from './page-data-public-service.mjs';
|
||||
import { createUserDataSpaceService } from './user-data-space-service.mjs';
|
||||
import { writePageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
import { writePageAccessPolicy, readPageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
import { publicationInternals } from './mindspace-publications.mjs';
|
||||
|
||||
const PAGE_ID = 'page-public-1';
|
||||
@@ -111,6 +111,31 @@ test('public page read is denied in public access mode by default', async () =>
|
||||
);
|
||||
});
|
||||
|
||||
test('login_required page read requires login and works for authenticated visitor', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-login-required-'));
|
||||
const ownerService = await setupPublicWorkspace(workspaceRoot, {
|
||||
accessMode: 'login_required',
|
||||
withRead: true,
|
||||
});
|
||||
await ownerService.insertRowForDataset(ownerService.getDataset('signups'), {
|
||||
name: '登录可见',
|
||||
phone: '13800000002',
|
||||
});
|
||||
|
||||
const service = createPublicService(workspaceRoot, { accessMode: 'login_required' });
|
||||
await assert.rejects(
|
||||
() => service.listRows(PAGE_ID, 'signups', { headers: {} }),
|
||||
(error) => error.code === 'auth_required',
|
||||
);
|
||||
|
||||
const rows = await service.listRows(PAGE_ID, 'signups', {
|
||||
currentUser: { id: 'visitor-1' },
|
||||
headers: {},
|
||||
});
|
||||
assert.equal(rows.rows.length, 1);
|
||||
assert.equal(rows.rows[0].name, '登录可见');
|
||||
});
|
||||
|
||||
test('password page data-auth returns token and enables read', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-password-'));
|
||||
const ownerService = await setupPublicWorkspace(workspaceRoot, {
|
||||
@@ -174,3 +199,214 @@ test('isPageDataPublicPath allows public page data routes without auth', () => {
|
||||
assert.equal(isPageDataPublicPath('/public/pages/page-1/data/signups', 'GET'), true);
|
||||
assert.equal(isPageDataPublicPath('/page-data/signups', 'GET'), false);
|
||||
});
|
||||
|
||||
async function setupCollaborationWorkspace(workspaceRoot) {
|
||||
const service = createUserDataSpaceService({ workspaceRoot });
|
||||
await service.executeSql(`CREATE TABLE notes (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
title TEXT NOT NULL,
|
||||
status TEXT DEFAULT 'open',
|
||||
created_by_user_id TEXT,
|
||||
created_at TEXT,
|
||||
deleted_at TEXT,
|
||||
deleted_by TEXT,
|
||||
updated_at TEXT,
|
||||
updated_by_label TEXT
|
||||
);`);
|
||||
await service.upsertDataset({
|
||||
name: 'notes',
|
||||
table: 'notes',
|
||||
actions: ['read', 'insert', 'update', 'soft_delete'],
|
||||
columns: {
|
||||
read: ['id', 'title', 'status', 'created_by_user_id', 'created_at'],
|
||||
insert: ['title'],
|
||||
update: ['status'],
|
||||
soft_delete: ['id'],
|
||||
},
|
||||
});
|
||||
writePageAccessPolicy(workspaceRoot, {
|
||||
pageId: PAGE_ID,
|
||||
ownerUserId: OWNER_ID,
|
||||
accessMode: 'login_required',
|
||||
defaultVisitorRole: 'deny',
|
||||
visitors: {
|
||||
'editor-a': 'editor',
|
||||
'viewer-a': 'viewer',
|
||||
},
|
||||
datasets: {
|
||||
notes: {
|
||||
read: true,
|
||||
insert: true,
|
||||
update: true,
|
||||
softDelete: true,
|
||||
rowPolicy: { scope: 'own_rows', ownerColumn: 'created_by_user_id' },
|
||||
columns: {
|
||||
read: ['id', 'title', 'status', 'created_by_user_id', 'created_at'],
|
||||
insert: ['title'],
|
||||
update: ['status'],
|
||||
},
|
||||
},
|
||||
},
|
||||
});
|
||||
return service;
|
||||
}
|
||||
|
||||
test('login_required editor can insert and update only own_rows', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-role-editor-'));
|
||||
const ownerService = await setupCollaborationWorkspace(workspaceRoot);
|
||||
const service = createPublicService(workspaceRoot, { accessMode: 'login_required' });
|
||||
|
||||
const inserted = await service.insertRow(
|
||||
PAGE_ID,
|
||||
'notes',
|
||||
{ currentUser: { id: 'editor-a' }, ip: '127.0.0.1', headers: {} },
|
||||
{ title: '编辑者 A 的笔记' },
|
||||
);
|
||||
assert.equal(inserted.row.title, '编辑者 A 的笔记');
|
||||
|
||||
const insertedB = await ownerService.insertRowForDataset(ownerService.getDataset('notes'), {
|
||||
title: '编辑者 B 的笔记',
|
||||
});
|
||||
await ownerService.executeSql(
|
||||
`UPDATE notes SET created_by_user_id = 'editor-b' WHERE id = ${insertedB.row.id};`,
|
||||
);
|
||||
|
||||
const rowsA = await service.listRows(PAGE_ID, 'notes', {
|
||||
currentUser: { id: 'editor-a' },
|
||||
headers: {},
|
||||
});
|
||||
assert.equal(rowsA.rows.length, 1);
|
||||
assert.equal(rowsA.rows[0].title, '编辑者 A 的笔记');
|
||||
|
||||
const updated = await service.updateRow(
|
||||
PAGE_ID,
|
||||
'notes',
|
||||
inserted.row.id,
|
||||
{ currentUser: { id: 'editor-a' }, ip: '127.0.0.1', headers: {}, body: {} },
|
||||
{ status: 'done' },
|
||||
);
|
||||
assert.equal(updated.row.status, 'done');
|
||||
|
||||
await assert.rejects(
|
||||
() =>
|
||||
service.updateRow(
|
||||
PAGE_ID,
|
||||
'notes',
|
||||
insertedB.row.id,
|
||||
{ currentUser: { id: 'editor-a' }, ip: '127.0.0.1', headers: {}, body: {} },
|
||||
{ status: 'hijacked' },
|
||||
),
|
||||
(error) => error.code === 'row_not_allowed',
|
||||
);
|
||||
});
|
||||
|
||||
test('login_required viewer can read but cannot insert', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-role-viewer-'));
|
||||
const ownerService = await setupCollaborationWorkspace(workspaceRoot);
|
||||
await ownerService.executeSql(
|
||||
`INSERT INTO notes (title, created_by_user_id, created_at) VALUES ('owner seed', '${OWNER_ID}', datetime('now'));`,
|
||||
);
|
||||
|
||||
const service = createPublicService(workspaceRoot, { accessMode: 'login_required' });
|
||||
const rows = await service.listRows(PAGE_ID, 'notes', {
|
||||
currentUser: { id: 'viewer-a' },
|
||||
headers: {},
|
||||
});
|
||||
assert.equal(rows.rows.length, 0);
|
||||
|
||||
await assert.rejects(
|
||||
() =>
|
||||
service.insertRow(
|
||||
PAGE_ID,
|
||||
'notes',
|
||||
{ currentUser: { id: 'viewer-a' }, ip: '127.0.0.1', headers: {} },
|
||||
{ title: 'viewer insert' },
|
||||
),
|
||||
(error) => error.code === 'action_not_allowed',
|
||||
);
|
||||
});
|
||||
|
||||
test('login_required denies visitors not listed when defaultVisitorRole is deny', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-role-deny-'));
|
||||
await setupCollaborationWorkspace(workspaceRoot);
|
||||
const service = createPublicService(workspaceRoot, { accessMode: 'login_required' });
|
||||
await assert.rejects(
|
||||
() =>
|
||||
service.listRows(PAGE_ID, 'notes', {
|
||||
currentUser: { id: 'stranger-1' },
|
||||
headers: {},
|
||||
}),
|
||||
(error) => error.code === 'forbidden',
|
||||
);
|
||||
});
|
||||
|
||||
test('public insert requires captcha when turnstile secret is configured', async () => {
|
||||
const previousSecret = process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
process.env.PAGE_DATA_TURNSTILE_SECRET = 'test-secret';
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-captcha-required-'));
|
||||
await setupPublicWorkspace(workspaceRoot);
|
||||
const service = createPublicService(workspaceRoot, { accessMode: 'public' });
|
||||
try {
|
||||
await assert.rejects(
|
||||
() =>
|
||||
service.insertRow(PAGE_ID, 'signups', { ip: '127.0.0.1', headers: {} }, {
|
||||
name: '匿名用户',
|
||||
phone: '13900000000',
|
||||
}),
|
||||
(error) => error.code === 'captcha_required',
|
||||
);
|
||||
} finally {
|
||||
if (previousSecret == null) delete process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
else process.env.PAGE_DATA_TURNSTILE_SECRET = previousSecret;
|
||||
}
|
||||
});
|
||||
|
||||
test('public insert accepts verified captcha token', async () => {
|
||||
const previousSecret = process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
const previousFetch = globalThis.fetch;
|
||||
process.env.PAGE_DATA_TURNSTILE_SECRET = 'test-secret';
|
||||
globalThis.fetch = async () => ({
|
||||
ok: true,
|
||||
async json() {
|
||||
return { success: true };
|
||||
},
|
||||
});
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-captcha-ok-'));
|
||||
await setupPublicWorkspace(workspaceRoot);
|
||||
const service = createPublicService(workspaceRoot, { accessMode: 'public' });
|
||||
try {
|
||||
const result = await service.insertRow(
|
||||
PAGE_ID,
|
||||
'signups',
|
||||
{ ip: '127.0.0.1', headers: { 'x-page-data-captcha': 'turnstile-token' } },
|
||||
{ name: '验证码用户', phone: '13900000001' },
|
||||
);
|
||||
assert.equal(result.row.name, '验证码用户');
|
||||
} finally {
|
||||
globalThis.fetch = previousFetch;
|
||||
if (previousSecret == null) delete process.env.PAGE_DATA_TURNSTILE_SECRET;
|
||||
else process.env.PAGE_DATA_TURNSTILE_SECRET = previousSecret;
|
||||
}
|
||||
});
|
||||
|
||||
test('saveOwnerPolicyFromPublish writes policy for published page', async () => {
|
||||
const workspaceRoot = fs.mkdtempSync(path.join(os.tmpdir(), 'page-data-apply-publish-'));
|
||||
await setupPublicWorkspace(workspaceRoot, { accessMode: 'password', withRead: true });
|
||||
const service = createPublicService(workspaceRoot, { accessMode: 'password' });
|
||||
const user = { id: OWNER_ID, workspaceRoot };
|
||||
const policy = await service.saveOwnerPolicyFromPublish(user, PAGE_ID, {
|
||||
datasetName: 'signups',
|
||||
capabilities: {
|
||||
read: true,
|
||||
insert: true,
|
||||
update: false,
|
||||
softDelete: false,
|
||||
},
|
||||
});
|
||||
assert.equal(policy.pageId, PAGE_ID);
|
||||
assert.equal(policy.accessMode, 'password');
|
||||
assert.equal(policy.datasets.signups.read, true);
|
||||
assert.equal(policy.datasets.signups.insert, true);
|
||||
const saved = readPageAccessPolicy(workspaceRoot, PAGE_ID);
|
||||
assert.equal(saved.datasets.signups.read, true);
|
||||
});
|
||||
|
||||
@@ -0,0 +1,24 @@
|
||||
import { readPageAccessPolicy, writePageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
|
||||
const PAGE_DATA_ACCESS_MODES = new Set(['public', 'password', 'login_required']);
|
||||
|
||||
export function mapPublicationAccessModeToPageData(accessMode) {
|
||||
const mode = String(accessMode ?? '').trim();
|
||||
if (PAGE_DATA_ACCESS_MODES.has(mode)) return mode;
|
||||
return null;
|
||||
}
|
||||
|
||||
export function syncPageDataPolicyAccessMode(workspaceRoot, pageId, publicationAccessMode, ownerUserId) {
|
||||
const mapped = mapPublicationAccessModeToPageData(publicationAccessMode);
|
||||
if (!mapped) return null;
|
||||
const policy = readPageAccessPolicy(workspaceRoot, pageId);
|
||||
if (!policy) return null;
|
||||
if (policy.ownerUserId !== ownerUserId) return null;
|
||||
if (policy.accessMode === mapped) return policy;
|
||||
return writePageAccessPolicy(workspaceRoot, {
|
||||
...policy,
|
||||
pageId,
|
||||
ownerUserId,
|
||||
accessMode: mapped,
|
||||
});
|
||||
}
|
||||
+152
-5
@@ -1,3 +1,4 @@
|
||||
import { stripPageDataMetaFields } from './page-data-captcha.mjs';
|
||||
import { mapPageDataPublicError } from './page-data-public-service.mjs';
|
||||
|
||||
function requireUser(req, res, sendError) {
|
||||
@@ -14,12 +15,12 @@ function parsePositiveInt(value, fallback) {
|
||||
return Math.floor(parsed);
|
||||
}
|
||||
|
||||
function parseRowPayload(req) {
|
||||
function parseRowPayload(req, { stripMeta = false } = {}) {
|
||||
const payload = req.body?.row && typeof req.body.row === 'object' ? req.body.row : req.body;
|
||||
if (!payload || typeof payload !== 'object' || Array.isArray(payload)) {
|
||||
return null;
|
||||
}
|
||||
return payload;
|
||||
return stripMeta ? stripPageDataMetaFields(payload) : payload;
|
||||
}
|
||||
|
||||
function handlePublicError(res, req, sendError, error) {
|
||||
@@ -44,6 +45,19 @@ export function attachPageDataRoutes(api, deps) {
|
||||
}
|
||||
});
|
||||
|
||||
api.get('/page-data/policies', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
try {
|
||||
const policies = await publicService.listOwnerPolicies(user);
|
||||
return sendData(res, req, { policies });
|
||||
} catch (error) {
|
||||
return handlePublicError(res, req, sendError, error);
|
||||
}
|
||||
});
|
||||
|
||||
api.get('/page-data/policies/:pageId', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
@@ -58,6 +72,24 @@ export function attachPageDataRoutes(api, deps) {
|
||||
}
|
||||
});
|
||||
|
||||
api.post('/page-data/policies/:pageId/apply-publish', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
const datasetName = String(req.body?.datasetName ?? req.body?.dataset ?? '').trim();
|
||||
if (!datasetName) return sendError(res, req, 400, 'invalid_request', '缺少 datasetName');
|
||||
try {
|
||||
const policy = await publicService.saveOwnerPolicyFromPublish(user, req.params.pageId, {
|
||||
datasetName,
|
||||
capabilities: req.body?.capabilities ?? {},
|
||||
});
|
||||
return sendData(res, req, { policy });
|
||||
} catch (error) {
|
||||
return handlePublicError(res, req, sendError, error);
|
||||
}
|
||||
});
|
||||
|
||||
api.put('/page-data/policies/:pageId', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
@@ -71,6 +103,106 @@ export function attachPageDataRoutes(api, deps) {
|
||||
}
|
||||
});
|
||||
|
||||
api.get('/page-data/policies/:pageId/logs', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const service = getPageDataService?.();
|
||||
if (!service) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
try {
|
||||
const result = await service.listPageLogs(user, req.params.pageId, {
|
||||
limit: parsePositiveInt(req.query.limit, 100),
|
||||
offset: parsePositiveInt(req.query.offset, 0),
|
||||
});
|
||||
return sendData(res, req, result);
|
||||
} catch (error) {
|
||||
const status = error?.status ?? 400;
|
||||
return sendError(res, req, status, error?.code ?? 'page_data_failed', error?.message ?? '读取失败');
|
||||
}
|
||||
});
|
||||
|
||||
api.get('/page-data/policies/:pageId/ops', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
try {
|
||||
const overview = await publicService.getPageOpsOverview(user, req.params.pageId);
|
||||
return sendData(res, req, overview);
|
||||
} catch (error) {
|
||||
return handlePublicError(res, req, sendError, error);
|
||||
}
|
||||
});
|
||||
|
||||
api.post('/page-data/policies/:pageId/tokens/revoke', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
try {
|
||||
const result = await publicService.revokePageDataTokens(user, req.params.pageId, {
|
||||
token: req.body?.token ?? null,
|
||||
revokeAll: Boolean(req.body?.revokeAll ?? req.body?.revoke_all),
|
||||
});
|
||||
return sendData(res, req, result);
|
||||
} catch (error) {
|
||||
return handlePublicError(res, req, sendError, error);
|
||||
}
|
||||
});
|
||||
|
||||
api.post('/page-data/policies/:pageId/password/reset', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
const password = String(req.body?.password ?? '').trim();
|
||||
if (!password) return sendError(res, req, 400, 'invalid_request', '缺少新口令');
|
||||
try {
|
||||
const result = await publicService.resetPageDataPassword(user, req.params.pageId, password);
|
||||
return sendData(res, req, result);
|
||||
} catch (error) {
|
||||
return handlePublicError(res, req, sendError, error);
|
||||
}
|
||||
});
|
||||
|
||||
api.post('/page-data/policies/:pageId/datasets/:dataset/close', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
try {
|
||||
const result = await publicService.closePageDataset(user, req.params.pageId, req.params.dataset);
|
||||
return sendData(res, req, result);
|
||||
} catch (error) {
|
||||
return handlePublicError(res, req, sendError, error);
|
||||
}
|
||||
});
|
||||
|
||||
api.get('/page-data/:dataset/export', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const service = getPageDataService?.();
|
||||
if (!service) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
try {
|
||||
const exported = await service.exportDataset(user, req.params.dataset, {
|
||||
format: req.query.format,
|
||||
include_deleted: req.query.include_deleted,
|
||||
limit: parsePositiveInt(req.query.limit, 1000),
|
||||
});
|
||||
if (exported.format === 'csv') {
|
||||
res.setHeader('content-type', 'text/csv; charset=utf-8');
|
||||
res.setHeader(
|
||||
'content-disposition',
|
||||
`attachment; filename="${encodeURIComponent(exported.dataset)}.csv"`,
|
||||
);
|
||||
return res.status(200).send(exported.content);
|
||||
}
|
||||
return sendData(res, req, exported);
|
||||
} catch (error) {
|
||||
const status = error?.status ?? 400;
|
||||
return sendError(res, req, status, error?.code ?? 'page_data_failed', error?.message ?? '导出失败');
|
||||
}
|
||||
});
|
||||
|
||||
api.get('/page-data/:dataset', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
@@ -82,6 +214,7 @@ export function attachPageDataRoutes(api, deps) {
|
||||
offset: parsePositiveInt(req.query.offset, 0),
|
||||
orderBy: req.query.order_by,
|
||||
orderDir: req.query.order_dir,
|
||||
include_deleted: req.query.include_deleted,
|
||||
});
|
||||
return sendData(res, req, {
|
||||
dataset: result.dataset.name,
|
||||
@@ -128,7 +261,7 @@ export function attachPageDataRoutes(api, deps) {
|
||||
if (!user) return;
|
||||
const service = getPageDataService?.();
|
||||
if (!service) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
const payload = parseRowPayload(req);
|
||||
const payload = parseRowPayload(req, { stripMeta: true });
|
||||
if (!payload) return sendError(res, req, 400, 'invalid_request', '提交数据必须是 JSON 对象');
|
||||
try {
|
||||
const result = await service.insertRow(user, req.params.dataset, payload);
|
||||
@@ -139,6 +272,20 @@ export function attachPageDataRoutes(api, deps) {
|
||||
}
|
||||
});
|
||||
|
||||
api.post('/page-data/:dataset/rows/:rowId/restore', async (req, res) => {
|
||||
const user = requireUser(req, res, sendError);
|
||||
if (!user) return;
|
||||
const service = getPageDataService?.();
|
||||
if (!service) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
try {
|
||||
const result = await service.restoreRow(user, req.params.dataset, req.params.rowId);
|
||||
return sendData(res, req, result);
|
||||
} catch (error) {
|
||||
const status = error?.status ?? 400;
|
||||
return sendError(res, req, status, error?.code ?? 'page_data_failed', error?.message ?? '恢复失败');
|
||||
}
|
||||
});
|
||||
|
||||
api.post('/public/pages/:pageId/data-auth', async (req, res) => {
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
@@ -198,7 +345,7 @@ export function attachPageDataRoutes(api, deps) {
|
||||
api.post('/public/pages/:pageId/data/:dataset/rows', async (req, res) => {
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
const payload = parseRowPayload(req);
|
||||
const payload = parseRowPayload(req, { stripMeta: true });
|
||||
if (!payload) return sendError(res, req, 400, 'invalid_request', '提交数据必须是 JSON 对象');
|
||||
try {
|
||||
const result = await publicService.insertRow(req.params.pageId, req.params.dataset, req, payload);
|
||||
@@ -211,7 +358,7 @@ export function attachPageDataRoutes(api, deps) {
|
||||
api.patch('/public/pages/:pageId/data/:dataset/rows/:rowId', async (req, res) => {
|
||||
const publicService = getPageDataPublicService?.();
|
||||
if (!publicService) return sendError(res, req, 503, 'feature_disabled', 'Page Data API 未启用');
|
||||
const payload = parseRowPayload(req);
|
||||
const payload = parseRowPayload(req, { stripMeta: true });
|
||||
if (!payload) return sendError(res, req, 400, 'invalid_request', '更新数据必须是 JSON 对象');
|
||||
try {
|
||||
const result = await publicService.updateRow(
|
||||
|
||||
+72
-9
@@ -1,4 +1,6 @@
|
||||
import { createUserDataSpaceService } from './user-data-space-service.mjs';
|
||||
import { listPageDataLogs } from './page-data-log-store.mjs';
|
||||
import { readPageAccessPolicy } from './page-data-policy-store.mjs';
|
||||
|
||||
function mapServiceError(error) {
|
||||
const code = error?.code;
|
||||
@@ -11,6 +13,9 @@ function mapServiceError(error) {
|
||||
if (code === 'columns_not_allowed') {
|
||||
return { status: 403, code: 'columns_not_allowed', message: error.message };
|
||||
}
|
||||
if (code === 'invalid_row_id' || code === 'restore_unsupported') {
|
||||
return { status: 400, code: code ?? 'invalid_request', message: error.message };
|
||||
}
|
||||
if (code === 'invalid_payload' || code === 'payload_too_large' || code === 'invalid_dataset_config') {
|
||||
return { status: 400, code: code ?? 'invalid_request', message: error.message };
|
||||
}
|
||||
@@ -40,21 +45,25 @@ export function createPageDataService(deps = {}) {
|
||||
throw Object.assign(new Error('用户工作区不存在'), { code: 'workspace_not_found' });
|
||||
}
|
||||
const pool = getPool();
|
||||
return createUserDataSpaceService({
|
||||
return {
|
||||
workspaceRoot,
|
||||
userId: user.id,
|
||||
query: pool ?? null,
|
||||
});
|
||||
service: createUserDataSpaceService({
|
||||
workspaceRoot,
|
||||
userId: user.id,
|
||||
query: pool ?? null,
|
||||
}),
|
||||
};
|
||||
}
|
||||
|
||||
async function listRows(user, datasetName, query = {}) {
|
||||
const service = await createServiceForUser(user);
|
||||
const { service } = await createServiceForUser(user);
|
||||
try {
|
||||
return service.readDatasetRows(datasetName, {
|
||||
limit: query.limit,
|
||||
offset: query.offset,
|
||||
orderBy: query.orderBy ?? query.order_by,
|
||||
orderDir: query.orderDir ?? query.order_dir,
|
||||
includeDeleted: ['1', 'true', 'yes'].includes(String(query.include_deleted ?? '').toLowerCase()),
|
||||
});
|
||||
} catch (error) {
|
||||
throw mapServiceError(error);
|
||||
@@ -62,7 +71,7 @@ export function createPageDataService(deps = {}) {
|
||||
}
|
||||
|
||||
async function getSchema(user, datasetName) {
|
||||
const service = await createServiceForUser(user);
|
||||
const { service } = await createServiceForUser(user);
|
||||
try {
|
||||
return service.getDatasetSchema(datasetName);
|
||||
} catch (error) {
|
||||
@@ -71,7 +80,7 @@ export function createPageDataService(deps = {}) {
|
||||
}
|
||||
|
||||
async function getStats(user, datasetName) {
|
||||
const service = await createServiceForUser(user);
|
||||
const { service } = await createServiceForUser(user);
|
||||
try {
|
||||
return service.getDatasetStats(datasetName);
|
||||
} catch (error) {
|
||||
@@ -80,7 +89,7 @@ export function createPageDataService(deps = {}) {
|
||||
}
|
||||
|
||||
async function insertRow(user, datasetName, payload) {
|
||||
const service = await createServiceForUser(user);
|
||||
const { service } = await createServiceForUser(user);
|
||||
try {
|
||||
return service.insertDatasetRow(datasetName, payload);
|
||||
} catch (error) {
|
||||
@@ -88,8 +97,30 @@ export function createPageDataService(deps = {}) {
|
||||
}
|
||||
}
|
||||
|
||||
async function restoreRow(user, datasetName, rowId) {
|
||||
const { service } = await createServiceForUser(user);
|
||||
try {
|
||||
return service.restoreSoftDeletedRow(datasetName, rowId);
|
||||
} catch (error) {
|
||||
throw mapServiceError(error);
|
||||
}
|
||||
}
|
||||
|
||||
async function exportDataset(user, datasetName, query = {}) {
|
||||
const { service } = await createServiceForUser(user);
|
||||
try {
|
||||
return service.exportDatasetRows(datasetName, {
|
||||
format: query.format,
|
||||
includeDeleted: ['1', 'true', 'yes'].includes(String(query.include_deleted ?? '').toLowerCase()),
|
||||
limit: query.limit,
|
||||
});
|
||||
} catch (error) {
|
||||
throw mapServiceError(error);
|
||||
}
|
||||
}
|
||||
|
||||
async function listDatasets(user) {
|
||||
const service = await createServiceForUser(user);
|
||||
const { service } = await createServiceForUser(user);
|
||||
return service.listDatasets().map((dataset) => ({
|
||||
name: dataset.name,
|
||||
table: dataset.table,
|
||||
@@ -98,12 +129,44 @@ export function createPageDataService(deps = {}) {
|
||||
}));
|
||||
}
|
||||
|
||||
async function assertPageOwner(user, pageId) {
|
||||
const pool = getPool();
|
||||
if (pool) {
|
||||
const [rows] = await pool.query(
|
||||
`SELECT user_id FROM h5_publish_records
|
||||
WHERE page_id = ? AND status = 'online'
|
||||
ORDER BY published_at DESC
|
||||
LIMIT 1`,
|
||||
[pageId],
|
||||
);
|
||||
const ownerId = rows[0]?.user_id;
|
||||
if (ownerId && ownerId === user.id) return;
|
||||
}
|
||||
const workspaceRoot = await resolveWorkspaceRoot(user);
|
||||
const policy = readPageAccessPolicy(workspaceRoot, pageId);
|
||||
if (policy?.ownerUserId === user.id) return;
|
||||
throw Object.assign(new Error('无权访问该页面数据'), { code: 'forbidden', status: 403 });
|
||||
}
|
||||
|
||||
async function listPageLogs(user, pageId, query = {}) {
|
||||
await assertPageOwner(user, pageId);
|
||||
const { workspaceRoot } = await createServiceForUser(user);
|
||||
const logs = listPageDataLogs(workspaceRoot, pageId, {
|
||||
limit: query.limit,
|
||||
offset: query.offset,
|
||||
});
|
||||
return { pageId, logs, count: logs.length };
|
||||
}
|
||||
|
||||
return {
|
||||
getUserAuth,
|
||||
listRows,
|
||||
getSchema,
|
||||
getStats,
|
||||
insertRow,
|
||||
restoreRow,
|
||||
exportDataset,
|
||||
listDatasets,
|
||||
listPageLogs,
|
||||
};
|
||||
}
|
||||
|
||||
@@ -41,6 +41,34 @@ export function createPageDataSessionStore(options = {}) {
|
||||
return sessions.delete(hashToken(token));
|
||||
}
|
||||
|
||||
function revokeByPageId(pageId) {
|
||||
let count = 0;
|
||||
for (const [key, session] of sessions.entries()) {
|
||||
if (session.pageId === pageId) {
|
||||
sessions.delete(key);
|
||||
count += 1;
|
||||
}
|
||||
}
|
||||
return count;
|
||||
}
|
||||
|
||||
function listByPageId(pageId) {
|
||||
const now = Date.now();
|
||||
const active = [];
|
||||
for (const session of sessions.values()) {
|
||||
if (session.pageId !== pageId) continue;
|
||||
if (session.expiresAt <= now) continue;
|
||||
active.push({
|
||||
sessionId: session.sessionId,
|
||||
pageId: session.pageId,
|
||||
ownerUserId: session.ownerUserId,
|
||||
accessMode: session.accessMode,
|
||||
expiresAt: session.expiresAt,
|
||||
});
|
||||
}
|
||||
return active;
|
||||
}
|
||||
|
||||
function clearExpired() {
|
||||
const now = Date.now();
|
||||
for (const [key, session] of sessions.entries()) {
|
||||
@@ -48,7 +76,7 @@ export function createPageDataSessionStore(options = {}) {
|
||||
}
|
||||
}
|
||||
|
||||
return { issue, verify, revoke, clearExpired };
|
||||
return { issue, verify, revoke, revokeByPageId, listByPageId, clearExpired };
|
||||
}
|
||||
|
||||
export function createPageDataRateLimiter(options = {}) {
|
||||
|
||||
@@ -0,0 +1,13 @@
|
||||
import assert from 'node:assert/strict';
|
||||
import test from 'node:test';
|
||||
import { createPageDataSessionStore } from './page-data-session-store.mjs';
|
||||
|
||||
test('session store revokeByPageId and listByPageId work per page', () => {
|
||||
const store = createPageDataSessionStore({ ttlMs: 60_000 });
|
||||
const a = store.issue({ pageId: 'page-a', ownerUserId: 'owner-1', publicationId: 'pub-a', accessMode: 'password' });
|
||||
const b = store.issue({ pageId: 'page-b', ownerUserId: 'owner-1', publicationId: 'pub-b', accessMode: 'password' });
|
||||
assert.equal(store.listByPageId('page-a').length, 1);
|
||||
assert.equal(store.revokeByPageId('page-a'), 1);
|
||||
assert.equal(store.verify(a.token), null);
|
||||
assert.ok(store.verify(b.token));
|
||||
});
|
||||
@@ -0,0 +1,117 @@
|
||||
(function (global) {
|
||||
'use strict';
|
||||
|
||||
function normalizeApiBase(apiBase) {
|
||||
var base = String(apiBase || '/api').trim() || '/api';
|
||||
return base.replace(/\/$/, '');
|
||||
}
|
||||
|
||||
function buildAuthPath(apiBase, pageId) {
|
||||
return normalizeApiBase(apiBase) + '/public/pages/' + encodeURIComponent(String(pageId || '').trim()) + '/data-auth';
|
||||
}
|
||||
|
||||
function buildDataPath(apiBase, pageId, dataset, suffix) {
|
||||
var base = normalizeApiBase(apiBase);
|
||||
var tail = suffix ? (String(suffix).charAt(0) === '/' ? suffix : '/' + suffix) : '';
|
||||
return base + '/public/pages/' + encodeURIComponent(String(pageId || '').trim()) + '/data/' + encodeURIComponent(String(dataset || '').trim()) + tail;
|
||||
}
|
||||
|
||||
function buildAuthHeaders(token) {
|
||||
var headers = { accept: 'application/json' };
|
||||
if (token) headers['x-page-data-token'] = token;
|
||||
return headers;
|
||||
}
|
||||
|
||||
function resolveCaptchaToken(options) {
|
||||
options = options || {};
|
||||
return options.captchaToken || options.turnstileToken || options.captcha_token || null;
|
||||
}
|
||||
|
||||
async function parseJsonResponse(response) {
|
||||
var payload = await response.json().catch(function () { return {}; });
|
||||
if (!response.ok) {
|
||||
var error = (payload && payload.error) || {};
|
||||
var err = new Error(error.message || '页面数据请求失败');
|
||||
err.code = error.code || 'page_data_failed';
|
||||
err.status = response.status;
|
||||
throw err;
|
||||
}
|
||||
return (payload && payload.data) || payload;
|
||||
}
|
||||
|
||||
function createClient(options) {
|
||||
options = options || {};
|
||||
var pageId = options.pageId;
|
||||
var apiBase = options.apiBase || '/api';
|
||||
var fetchImpl = options.fetchImpl || global.fetch;
|
||||
var sessionToken = options.token || null;
|
||||
if (!pageId) throw new Error('pageId 不能为空');
|
||||
if (typeof fetchImpl !== 'function') throw new Error('fetch 不可用');
|
||||
|
||||
async function request(method, path, opts) {
|
||||
opts = opts || {};
|
||||
var url = new URL(path, global.location ? global.location.origin : 'http://localhost');
|
||||
if (opts.query) {
|
||||
Object.keys(opts.query).forEach(function (key) {
|
||||
var value = opts.query[key];
|
||||
if (value == null || value === '') return;
|
||||
url.searchParams.set(key, String(value));
|
||||
});
|
||||
}
|
||||
var headers = Object.assign(
|
||||
{},
|
||||
opts.body ? { 'content-type': 'application/json' } : {},
|
||||
opts.auth === false ? { accept: 'application/json' } : buildAuthHeaders(sessionToken),
|
||||
opts.extraHeaders || {},
|
||||
);
|
||||
var response = await fetchImpl(url.toString(), {
|
||||
method: method,
|
||||
headers: headers,
|
||||
credentials: 'include',
|
||||
body: opts.body ? JSON.stringify(opts.body) : undefined,
|
||||
});
|
||||
return parseJsonResponse(response);
|
||||
}
|
||||
|
||||
return {
|
||||
get pageId() { return pageId; },
|
||||
get token() { return sessionToken; },
|
||||
setToken: function (nextToken) { sessionToken = nextToken ? String(nextToken) : null; },
|
||||
authenticate: function (password) {
|
||||
return request('POST', buildAuthPath(apiBase, pageId), { body: { password: password }, auth: false })
|
||||
.then(function (result) {
|
||||
if (result && result.token) sessionToken = result.token;
|
||||
return result;
|
||||
});
|
||||
},
|
||||
listRows: function (dataset, query) {
|
||||
return request('GET', buildDataPath(apiBase, pageId, dataset), { query: query || {} });
|
||||
},
|
||||
getSchema: function (dataset) {
|
||||
return request('GET', buildDataPath(apiBase, pageId, dataset, 'schema'));
|
||||
},
|
||||
getStats: function (dataset) {
|
||||
return request('GET', buildDataPath(apiBase, pageId, dataset, 'stats'));
|
||||
},
|
||||
insertRow: function (dataset, row, insertOptions) {
|
||||
var captchaToken = resolveCaptchaToken(insertOptions);
|
||||
return request('POST', buildDataPath(apiBase, pageId, dataset, 'rows'), {
|
||||
body: row,
|
||||
extraHeaders: captchaToken ? { 'x-page-data-captcha': String(captchaToken) } : {},
|
||||
});
|
||||
},
|
||||
updateRow: function (dataset, rowId, row) {
|
||||
return request('PATCH', buildDataPath(apiBase, pageId, dataset, 'rows/' + rowId), { body: row });
|
||||
},
|
||||
deleteRow: function (dataset, rowId) {
|
||||
return request('DELETE', buildDataPath(apiBase, pageId, dataset, 'rows/' + rowId));
|
||||
},
|
||||
};
|
||||
}
|
||||
|
||||
global.MindSpacePageData = {
|
||||
createClient: createClient,
|
||||
buildAuthPath: buildAuthPath,
|
||||
buildDataPath: buildDataPath,
|
||||
};
|
||||
})(typeof window !== 'undefined' ? window : globalThis);
|
||||
+11
@@ -250,6 +250,17 @@ CREATE TABLE IF NOT EXISTS h5_publish_records (
|
||||
CONSTRAINT fk_h5_publish_scan FOREIGN KEY (security_scan_id) REFERENCES h5_security_scans(id) ON DELETE CASCADE
|
||||
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci;
|
||||
|
||||
CREATE TABLE IF NOT EXISTS h5_page_data_policy_index (
|
||||
page_id CHAR(36) PRIMARY KEY,
|
||||
owner_user_id CHAR(36) NOT NULL,
|
||||
access_mode VARCHAR(32) NOT NULL,
|
||||
dataset_count INT UNSIGNED NOT NULL DEFAULT 0,
|
||||
scope_hash CHAR(16) NOT NULL,
|
||||
updated_at BIGINT NOT NULL,
|
||||
KEY idx_h5_page_data_policy_owner (owner_user_id, updated_at),
|
||||
CONSTRAINT fk_h5_page_data_policy_owner FOREIGN KEY (owner_user_id) REFERENCES h5_users(id) ON DELETE CASCADE
|
||||
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci;
|
||||
|
||||
CREATE TABLE IF NOT EXISTS h5_publication_asset_refs (
|
||||
publication_id CHAR(36) NOT NULL,
|
||||
asset_id CHAR(36) NOT NULL,
|
||||
|
||||
@@ -141,6 +141,14 @@ const SCOPE_RULES = [
|
||||
'page-data-routes.test.mjs',
|
||||
'page-data-public-service.test.mjs',
|
||||
'page-data-integration.test.mjs',
|
||||
'page-data-acceptance.test.mjs',
|
||||
'page-data-log-store.test.mjs',
|
||||
'page-access-visitor.test.mjs',
|
||||
'page-data-ops.test.mjs',
|
||||
'page-data-session-store.test.mjs',
|
||||
'page-data-browser-client.test.mjs',
|
||||
'page-data-policy-index.test.mjs',
|
||||
'page-data-captcha.test.mjs',
|
||||
'mindspace-sandbox-mcp.test.mjs',
|
||||
],
|
||||
},
|
||||
|
||||
+15
@@ -188,6 +188,8 @@ import { attachAsrRoutes } from './asr-proxy.mjs';
|
||||
import { attachPageDataRoutes } from './page-data-routes.mjs';
|
||||
import { createPageDataService } from './page-data-service.mjs';
|
||||
import { createPageDataPublicService, isPageDataPublicPath } from './page-data-public-service.mjs';
|
||||
import { syncPageDataPolicyAccessMode } from './page-data-publish-sync.mjs';
|
||||
import { upsertPageDataPolicyIndex } from './page-data-policy-index.mjs';
|
||||
import { isNativeH5ApiPath } from './policies.mjs';
|
||||
|
||||
const __dirname = path.dirname(fileURLToPath(import.meta.url));
|
||||
@@ -4233,6 +4235,18 @@ api.post('/mindspace/v1/pages/:pageId/publish', async (req, res) => {
|
||||
acknowledgedFindingIds: req.body?.acknowledged_finding_ids,
|
||||
},
|
||||
);
|
||||
const workspaceRoot = req.currentUser.workspaceRoot ?? null;
|
||||
if (workspaceRoot) {
|
||||
const syncedPolicy = syncPageDataPolicyAccessMode(
|
||||
workspaceRoot,
|
||||
req.params.pageId,
|
||||
publication.accessMode,
|
||||
req.currentUser.id,
|
||||
);
|
||||
if (syncedPolicy) {
|
||||
await upsertPageDataPolicyIndex(authPool, syncedPolicy).catch(() => null);
|
||||
}
|
||||
}
|
||||
await mindSpaceAudit?.write({
|
||||
userId: req.currentUser.id,
|
||||
action: 'page.publish',
|
||||
@@ -5970,6 +5984,7 @@ app.use(
|
||||
express.static(path.join(__dirname, 'public/plaza-covers'), { maxAge: '7d' }),
|
||||
);
|
||||
app.use('/brand', express.static(path.join(__dirname, 'public/brand'), { maxAge: '7d' }));
|
||||
app.use('/assets', express.static(path.join(__dirname, 'public/assets'), { maxAge: '1d' }));
|
||||
|
||||
app.get('/dev/wechat-share-preview', async (req, res) => {
|
||||
try {
|
||||
|
||||
@@ -34,6 +34,10 @@ import type {
|
||||
MindSpacePublication,
|
||||
MindSpacePublicationStats,
|
||||
MindSpacePublishCheck,
|
||||
PageDataAccessPolicy,
|
||||
PageDataDatasetSummary,
|
||||
PageDataLogEntry,
|
||||
PageDataOpsOverview,
|
||||
PlazaCategory,
|
||||
PlazaPostBrief,
|
||||
MindSpaceRedactedCopyResult,
|
||||
@@ -1458,6 +1462,165 @@ export async function updatePublicationStatus(
|
||||
return result.data;
|
||||
}
|
||||
|
||||
export async function listOwnerPageDataPolicies(): Promise<
|
||||
Array<{
|
||||
pageId: string;
|
||||
ownerUserId: string;
|
||||
accessMode: string;
|
||||
datasetCount: number;
|
||||
scopeHash: string;
|
||||
updatedAt: number;
|
||||
}>
|
||||
> {
|
||||
const result = await apiFetch<{
|
||||
data: {
|
||||
policies: Array<{
|
||||
pageId: string;
|
||||
ownerUserId: string;
|
||||
accessMode: string;
|
||||
datasetCount: number;
|
||||
scopeHash: string;
|
||||
updatedAt: number;
|
||||
}>;
|
||||
};
|
||||
}>('/page-data/policies');
|
||||
return result.data.policies;
|
||||
}
|
||||
|
||||
export function buildPageDataExportUrl(dataset: string, format: 'json' | 'csv' = 'json') {
|
||||
const params = new URLSearchParams({ format });
|
||||
return `/api/page-data/${encodeURIComponent(dataset)}/export?${params.toString()}`;
|
||||
}
|
||||
|
||||
export async function listPageDataDatasets(): Promise<PageDataDatasetSummary[]> {
|
||||
const result = await apiFetch<{ data: { datasets: PageDataDatasetSummary[] } }>('/page-data');
|
||||
return result.data.datasets;
|
||||
}
|
||||
|
||||
export async function getPageDataPolicy(pageId: string): Promise<PageDataAccessPolicy | null> {
|
||||
try {
|
||||
const result = await apiFetch<{ data: { policy: PageDataAccessPolicy } }>(
|
||||
`/page-data/policies/${encodeURIComponent(pageId)}`,
|
||||
);
|
||||
return result.data.policy;
|
||||
} catch (error) {
|
||||
if (error instanceof ApiError && error.status === 404) return null;
|
||||
throw error;
|
||||
}
|
||||
}
|
||||
|
||||
export async function applyPageDataPublishPolicy(
|
||||
pageId: string,
|
||||
input: {
|
||||
datasetName: string;
|
||||
capabilities?: {
|
||||
read?: boolean;
|
||||
insert?: boolean;
|
||||
update?: boolean;
|
||||
softDelete?: boolean;
|
||||
};
|
||||
},
|
||||
): Promise<PageDataAccessPolicy> {
|
||||
const result = await apiFetch<{ data: { policy: PageDataAccessPolicy } }>(
|
||||
`/page-data/policies/${encodeURIComponent(pageId)}/apply-publish`,
|
||||
{
|
||||
method: 'POST',
|
||||
body: JSON.stringify({
|
||||
datasetName: input.datasetName,
|
||||
capabilities: input.capabilities ?? {},
|
||||
}),
|
||||
},
|
||||
);
|
||||
return result.data.policy;
|
||||
}
|
||||
|
||||
export async function savePageDataPolicy(
|
||||
pageId: string,
|
||||
policy: Partial<PageDataAccessPolicy>,
|
||||
): Promise<PageDataAccessPolicy> {
|
||||
const result = await apiFetch<{ data: { policy: PageDataAccessPolicy } }>(
|
||||
`/page-data/policies/${encodeURIComponent(pageId)}`,
|
||||
{
|
||||
method: 'PUT',
|
||||
body: JSON.stringify(policy),
|
||||
},
|
||||
);
|
||||
return result.data.policy;
|
||||
}
|
||||
|
||||
export async function getPageDataOpsOverview(pageId: string): Promise<PageDataOpsOverview> {
|
||||
const result = await apiFetch<{ data: PageDataOpsOverview }>(
|
||||
`/page-data/policies/${encodeURIComponent(pageId)}/ops`,
|
||||
);
|
||||
return result.data;
|
||||
}
|
||||
|
||||
export async function listPageDataLogs(
|
||||
pageId: string,
|
||||
input: { limit?: number; offset?: number } = {},
|
||||
): Promise<{ pageId: string; logs: PageDataLogEntry[]; count: number }> {
|
||||
const params = new URLSearchParams();
|
||||
if (input.limit != null) params.set('limit', String(input.limit));
|
||||
if (input.offset != null) params.set('offset', String(input.offset));
|
||||
const query = params.toString();
|
||||
const result = await apiFetch<{ data: { pageId: string; logs: PageDataLogEntry[]; count: number } }>(
|
||||
`/page-data/policies/${encodeURIComponent(pageId)}/logs${query ? `?${query}` : ''}`,
|
||||
);
|
||||
return result.data;
|
||||
}
|
||||
|
||||
export async function revokePageDataTokens(
|
||||
pageId: string,
|
||||
input: { revokeAll?: boolean; token?: string },
|
||||
): Promise<{ pageId: string; revokedCount: number; revokeAll: boolean }> {
|
||||
const result = await apiFetch<{ data: { pageId: string; revokedCount: number; revokeAll: boolean } }>(
|
||||
`/page-data/policies/${encodeURIComponent(pageId)}/tokens/revoke`,
|
||||
{
|
||||
method: 'POST',
|
||||
body: JSON.stringify({
|
||||
revokeAll: Boolean(input.revokeAll),
|
||||
token: input.token,
|
||||
}),
|
||||
},
|
||||
);
|
||||
return result.data;
|
||||
}
|
||||
|
||||
export async function resetPageDataPassword(
|
||||
pageId: string,
|
||||
password: string,
|
||||
): Promise<{ pageId: string; passwordReset: boolean; revokedSessions: number }> {
|
||||
const result = await apiFetch<{
|
||||
data: { pageId: string; passwordReset: boolean; revokedSessions: number };
|
||||
}>(`/page-data/policies/${encodeURIComponent(pageId)}/password/reset`, {
|
||||
method: 'POST',
|
||||
body: JSON.stringify({ password }),
|
||||
});
|
||||
return result.data;
|
||||
}
|
||||
|
||||
export async function closePageDataDataset(
|
||||
pageId: string,
|
||||
dataset: string,
|
||||
): Promise<{ pageId: string; dataset: string; closed: boolean }> {
|
||||
const result = await apiFetch<{ data: { pageId: string; dataset: string; closed: boolean } }>(
|
||||
`/page-data/policies/${encodeURIComponent(pageId)}/datasets/${encodeURIComponent(dataset)}/close`,
|
||||
{ method: 'POST' },
|
||||
);
|
||||
return result.data;
|
||||
}
|
||||
|
||||
export async function restorePageDataRow(
|
||||
dataset: string,
|
||||
rowId: number | string,
|
||||
): Promise<{ restored: boolean; row: Record<string, unknown> }> {
|
||||
const result = await apiFetch<{ data: { restored: boolean; row: Record<string, unknown> } }>(
|
||||
`/page-data/${encodeURIComponent(dataset)}/rows/${encodeURIComponent(String(rowId))}/restore`,
|
||||
{ method: 'POST' },
|
||||
);
|
||||
return result.data;
|
||||
}
|
||||
|
||||
export async function redactMindSpacePage(
|
||||
pageId: string,
|
||||
input: {
|
||||
|
||||
@@ -0,0 +1,319 @@
|
||||
import { useCallback, useEffect, useState, type ReactNode } from 'react';
|
||||
import {
|
||||
buildPageDataExportUrl,
|
||||
closePageDataDataset,
|
||||
getPageDataOpsOverview,
|
||||
resetPageDataPassword,
|
||||
restorePageDataRow,
|
||||
revokePageDataTokens,
|
||||
} from '../api/client';
|
||||
import type { MindSpacePublishCheck, PageDataOpsOverview } from '../types';
|
||||
|
||||
type Props = {
|
||||
pageId: string;
|
||||
pageTitle: string;
|
||||
accessMode: MindSpacePublishCheck['accessMode'];
|
||||
onClose: () => void;
|
||||
};
|
||||
|
||||
function formatLogTime(value: string) {
|
||||
const date = new Date(value);
|
||||
if (Number.isNaN(date.getTime())) return value;
|
||||
return date.toLocaleString();
|
||||
}
|
||||
|
||||
export function MindSpacePageDataOpsPanel({ pageId, pageTitle, accessMode, onClose }: Props) {
|
||||
const [overview, setOverview] = useState<PageDataOpsOverview | null>(null);
|
||||
const [loading, setLoading] = useState(true);
|
||||
const [error, setError] = useState<string | null>(null);
|
||||
const [busyAction, setBusyAction] = useState<string | null>(null);
|
||||
const [newPassword, setNewPassword] = useState('');
|
||||
const [message, setMessage] = useState<string | null>(null);
|
||||
|
||||
const loadOverview = useCallback(async () => {
|
||||
setLoading(true);
|
||||
setError(null);
|
||||
try {
|
||||
const next = await getPageDataOpsOverview(pageId);
|
||||
setOverview(next);
|
||||
} catch (err) {
|
||||
const text = err instanceof Error ? err.message : '加载页面数据运维信息失败';
|
||||
if (text.includes('policy_not_found') || text.includes('策略未配置')) {
|
||||
setOverview(null);
|
||||
setError('当前页面尚未配置 Page Data 策略。请让 Agent 注册 dataset 并调用 private_data_set_page_policy。');
|
||||
} else {
|
||||
setError(text);
|
||||
}
|
||||
} finally {
|
||||
setLoading(false);
|
||||
}
|
||||
}, [pageId]);
|
||||
|
||||
useEffect(() => {
|
||||
void loadOverview();
|
||||
}, [loadOverview]);
|
||||
|
||||
const runAction = async (key: string, fn: () => Promise<void>) => {
|
||||
setBusyAction(key);
|
||||
setMessage(null);
|
||||
try {
|
||||
await fn();
|
||||
await loadOverview();
|
||||
} catch (err) {
|
||||
setMessage(err instanceof Error ? err.message : '操作失败');
|
||||
} finally {
|
||||
setBusyAction(null);
|
||||
}
|
||||
};
|
||||
|
||||
const recentDeletions =
|
||||
overview?.recentLogs.filter(
|
||||
(entry) => entry.action === 'soft_delete' && entry.dataset && entry.rowId != null,
|
||||
) ?? [];
|
||||
|
||||
return (
|
||||
<section className="mindspace-page-data-ops-panel">
|
||||
<div className="mindspace-page-data-ops-header">
|
||||
<div>
|
||||
<p className="mindspace-eyebrow">PAGE DATA</p>
|
||||
<h3>页面数据运维</h3>
|
||||
<small>
|
||||
{pageTitle} · 页面 ID {pageId}
|
||||
</small>
|
||||
</div>
|
||||
<button type="button" onClick={onClose}>
|
||||
关闭
|
||||
</button>
|
||||
</div>
|
||||
|
||||
{loading ? <p className="mindspace-page-data-ops-muted">加载中…</p> : null}
|
||||
{error ? <p className="mindspace-page-data-ops-error">{error}</p> : null}
|
||||
{message ? <p className="mindspace-page-data-ops-message">{message}</p> : null}
|
||||
|
||||
{overview ? (
|
||||
<>
|
||||
<div className="mindspace-page-data-ops-summary">
|
||||
<div>
|
||||
<span>访问模式</span>
|
||||
<strong>{overview.publication.accessMode}</strong>
|
||||
</div>
|
||||
<div>
|
||||
<span>策略索引</span>
|
||||
<strong>{overview.index?.scopeHash ?? '—'}</strong>
|
||||
</div>
|
||||
<div>
|
||||
<span>活跃会话</span>
|
||||
<strong>{overview.activeSessionCount}</strong>
|
||||
</div>
|
||||
<div>
|
||||
<span>Dataset 数</span>
|
||||
<strong>{overview.datasets.length}</strong>
|
||||
</div>
|
||||
<div>
|
||||
<span>最近提交</span>
|
||||
<strong>{overview.recentSubmissions.length}</strong>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{overview.unconfiguredDatasets && overview.unconfiguredDatasets.length > 0 ? (
|
||||
<div className="mindspace-page-data-ops-section">
|
||||
<h4>已注册但未纳入策略的 Dataset</h4>
|
||||
<p className="mindspace-page-data-ops-muted">
|
||||
{overview.unconfiguredDatasets.map((name) => (
|
||||
<code key={name}>{name}</code>
|
||||
)).reduce<ReactNode[]>((acc, node, index) => (
|
||||
index === 0 ? [node] : [...acc, '、', node]
|
||||
), [])}
|
||||
{' '}— 需通过 Agent 更新 Page Data 策略后才能公开访问。
|
||||
</p>
|
||||
</div>
|
||||
) : null}
|
||||
|
||||
<div className="mindspace-page-data-ops-section">
|
||||
<h4>Dataset 状态</h4>
|
||||
{overview.datasets.length === 0 ? (
|
||||
<p className="mindspace-page-data-ops-muted">策略中尚未声明 dataset。</p>
|
||||
) : (
|
||||
<div className="mindspace-page-data-ops-table-wrap">
|
||||
<table className="mindspace-page-data-ops-table">
|
||||
<thead>
|
||||
<tr>
|
||||
<th>名称</th>
|
||||
<th>读</th>
|
||||
<th>写</th>
|
||||
<th>更新</th>
|
||||
<th>删除</th>
|
||||
<th>行数</th>
|
||||
<th />
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody>
|
||||
{overview.datasets.map((dataset) => (
|
||||
<tr key={dataset.name}>
|
||||
<td>
|
||||
<code>{dataset.name}</code>
|
||||
{dataset.closed ? <span className="mindspace-page-data-ops-badge">已关闭</span> : null}
|
||||
</td>
|
||||
<td>{dataset.read ? '是' : '否'}</td>
|
||||
<td>{dataset.insert ? '是' : '否'}</td>
|
||||
<td>{dataset.update ? '是' : '否'}</td>
|
||||
<td>{dataset.softDelete ? '是' : '否'}</td>
|
||||
<td>{dataset.stats?.total ?? '—'}</td>
|
||||
<td>
|
||||
<div className="mindspace-page-data-ops-row-actions">
|
||||
{!dataset.closed ? (
|
||||
<button
|
||||
type="button"
|
||||
disabled={busyAction != null}
|
||||
onClick={() =>
|
||||
void runAction(`close-${dataset.name}`, async () => {
|
||||
await closePageDataDataset(pageId, dataset.name);
|
||||
setMessage(`已关闭 dataset:${dataset.name}`);
|
||||
})
|
||||
}
|
||||
>
|
||||
{busyAction === `close-${dataset.name}` ? '处理中…' : '关闭'}
|
||||
</button>
|
||||
) : null}
|
||||
<a
|
||||
href={buildPageDataExportUrl(dataset.name, 'json')}
|
||||
target="_blank"
|
||||
rel="noreferrer"
|
||||
>
|
||||
导出 JSON
|
||||
</a>
|
||||
<a
|
||||
href={buildPageDataExportUrl(dataset.name, 'csv')}
|
||||
target="_blank"
|
||||
rel="noreferrer"
|
||||
>
|
||||
导出 CSV
|
||||
</a>
|
||||
</div>
|
||||
</td>
|
||||
</tr>
|
||||
))}
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
)}
|
||||
</div>
|
||||
|
||||
<div className="mindspace-page-data-ops-section">
|
||||
<h4>最近提交</h4>
|
||||
{overview.recentSubmissions.length === 0 ? (
|
||||
<p className="mindspace-page-data-ops-muted">暂无公开写入记录。</p>
|
||||
) : (
|
||||
<ul className="mindspace-page-data-ops-log-list">
|
||||
{overview.recentSubmissions.map((entry, index) => (
|
||||
<li key={`${entry.at}-${entry.rowId ?? index}`}>
|
||||
<span>{formatLogTime(entry.at)}</span>
|
||||
<span>{entry.dataset}</span>
|
||||
<span>#{entry.rowId ?? '—'}</span>
|
||||
</li>
|
||||
))}
|
||||
</ul>
|
||||
)}
|
||||
</div>
|
||||
|
||||
<div className="mindspace-page-data-ops-section">
|
||||
<h4>最近操作日志</h4>
|
||||
{overview.recentLogs.length === 0 ? (
|
||||
<p className="mindspace-page-data-ops-muted">暂无操作日志。</p>
|
||||
) : (
|
||||
<ul className="mindspace-page-data-ops-log-list">
|
||||
{overview.recentLogs.map((entry, index) => (
|
||||
<li key={`${entry.at}-${entry.action}-${index}`}>
|
||||
<span>{formatLogTime(entry.at)}</span>
|
||||
<span>{entry.action}</span>
|
||||
<span>{entry.dataset ?? '—'}</span>
|
||||
<span>{entry.actor?.role ?? entry.actor?.type ?? '—'}</span>
|
||||
</li>
|
||||
))}
|
||||
</ul>
|
||||
)}
|
||||
</div>
|
||||
|
||||
<div className="mindspace-page-data-ops-actions">
|
||||
<button
|
||||
type="button"
|
||||
disabled={busyAction != null || overview.activeSessionCount === 0}
|
||||
onClick={() =>
|
||||
void runAction('revoke-all', async () => {
|
||||
const result = await revokePageDataTokens(pageId, { revokeAll: true });
|
||||
setMessage(`已撤销 ${result.revokedCount} 个活跃会话令牌。`);
|
||||
})
|
||||
}
|
||||
>
|
||||
{busyAction === 'revoke-all' ? '撤销中…' : '撤销全部数据令牌'}
|
||||
</button>
|
||||
|
||||
{accessMode === 'password' ? (
|
||||
<div className="mindspace-page-data-ops-password">
|
||||
<input
|
||||
type="password"
|
||||
value={newPassword}
|
||||
onChange={(event) => setNewPassword(event.target.value)}
|
||||
placeholder="新页面口令(至少 8 位)"
|
||||
autoComplete="new-password"
|
||||
/>
|
||||
<button
|
||||
type="button"
|
||||
disabled={busyAction != null || newPassword.trim().length < 8}
|
||||
onClick={() =>
|
||||
void runAction('reset-password', async () => {
|
||||
const result = await resetPageDataPassword(pageId, newPassword.trim());
|
||||
setNewPassword('');
|
||||
setMessage(
|
||||
`口令已重置,并撤销 ${result.revokedSessions} 个旧会话。`,
|
||||
);
|
||||
})
|
||||
}
|
||||
>
|
||||
{busyAction === 'reset-password' ? '重置中…' : '重置页面口令'}
|
||||
</button>
|
||||
</div>
|
||||
) : null}
|
||||
</div>
|
||||
|
||||
<div className="mindspace-page-data-ops-section">
|
||||
<h4>可恢复的软删除记录</h4>
|
||||
{recentDeletions.length === 0 ? (
|
||||
<p className="mindspace-page-data-ops-muted">最近日志中暂无可恢复记录。</p>
|
||||
) : (
|
||||
<ul className="mindspace-page-data-ops-log-list">
|
||||
{recentDeletions.map((entry, index) => (
|
||||
<li key={`${entry.at}-restore-${index}`}>
|
||||
<span>{formatLogTime(entry.at)}</span>
|
||||
<span>{entry.dataset}</span>
|
||||
<span>#{entry.rowId}</span>
|
||||
<button
|
||||
type="button"
|
||||
disabled={busyAction != null}
|
||||
onClick={() =>
|
||||
void runAction(`restore-${entry.dataset}-${entry.rowId}`, async () => {
|
||||
if (!entry.dataset || entry.rowId == null) return;
|
||||
await restorePageDataRow(entry.dataset, entry.rowId);
|
||||
setMessage(`已恢复 ${entry.dataset} #${entry.rowId}`);
|
||||
})
|
||||
}
|
||||
>
|
||||
{busyAction === `restore-${entry.dataset}-${entry.rowId}` ? '恢复中…' : '恢复'}
|
||||
</button>
|
||||
</li>
|
||||
))}
|
||||
</ul>
|
||||
)}
|
||||
</div>
|
||||
|
||||
<p className="mindspace-page-data-ops-hint">
|
||||
HTML 页面可引入 <code>/assets/page-data-client.js</code>,通过{' '}
|
||||
<code>MindSpacePageData.createClient({'{'} pageId {'}'})</code> 调用公开数据 API。
|
||||
公开表单提交可配合 Cloudflare Turnstile,调用{' '}
|
||||
<code>insertRow(dataset, row, {'{'} turnstileToken {'}'})</code> 传入验证码。
|
||||
</p>
|
||||
</>
|
||||
) : null}
|
||||
</section>
|
||||
);
|
||||
}
|
||||
@@ -1,12 +1,15 @@
|
||||
import { useCallback, useEffect, useRef, useState } from 'react';
|
||||
import { usePageDraftHistory, type PageDraftSnapshot } from '../hooks/usePageDraftHistory';
|
||||
import {
|
||||
applyPageDataPublishPolicy,
|
||||
checkMindSpacePagePublication,
|
||||
deleteMindSpacePage,
|
||||
fixMindSpacePagePublication,
|
||||
getMindSpacePageDeletePreview,
|
||||
getMindSpacePage,
|
||||
getMindSpacePublicationStats,
|
||||
getPageDataPolicy,
|
||||
listPageDataDatasets,
|
||||
listPlazaCategories,
|
||||
offlineMindSpacePublication,
|
||||
publishMindSpacePage,
|
||||
@@ -23,6 +26,7 @@ import type {
|
||||
MindSpacePublishCheck,
|
||||
MindSpaceQuota,
|
||||
MindSpaceRedactionChange,
|
||||
PageDataDatasetSummary,
|
||||
PlazaCategory,
|
||||
PlazaPostBrief,
|
||||
} from '../types';
|
||||
@@ -35,6 +39,7 @@ import { MindSpacePagePreviewPanel } from './MindSpacePagePreviewPanel';
|
||||
import { MindSpaceModal } from './MindSpaceModal';
|
||||
import { MindSpaceDeletePlazaOption } from './MindSpaceDeletePlazaOption';
|
||||
import { MindSpacePublishSuccess } from './MindSpacePublishSuccess';
|
||||
import { MindSpacePageDataOpsPanel } from './MindSpacePageDataOpsPanel';
|
||||
import { prepareHtmlPageBrandMarkers } from '../../mindspace-page-tag.mjs';
|
||||
|
||||
type AccessMode = MindSpacePublishCheck['accessMode'];
|
||||
@@ -67,6 +72,21 @@ const ACCESS_MODE_LABELS: Record<AccessMode, string> = {
|
||||
owner_only: '仅自己可见',
|
||||
};
|
||||
|
||||
const PAGE_DATA_PUBLISH_MODES = new Set<AccessMode>(['public', 'password', 'login_required']);
|
||||
|
||||
function defaultPageDataCapabilities(mode: AccessMode) {
|
||||
if (mode === 'public') {
|
||||
return { read: false, insert: true, update: false, softDelete: false };
|
||||
}
|
||||
if (mode === 'password') {
|
||||
return { read: true, insert: true, update: false, softDelete: false };
|
||||
}
|
||||
if (mode === 'login_required') {
|
||||
return { read: true, insert: true, update: true, softDelete: false };
|
||||
}
|
||||
return { read: false, insert: false, update: false, softDelete: false };
|
||||
}
|
||||
|
||||
function slugFromTitle(title: string, pageId?: string) {
|
||||
const ascii = title
|
||||
.normalize('NFKC')
|
||||
@@ -274,6 +294,16 @@ export function MindSpacePageDetail({
|
||||
const [isExportingImage, setIsExportingImage] = useState(false);
|
||||
const [exportFeedback, setExportFeedback] = useState<string | null>(null);
|
||||
const [plazaOpen, setPlazaOpen] = useState(false);
|
||||
const [pageDataOpsOpen, setPageDataOpsOpen] = useState(false);
|
||||
const [pageDataEnabled, setPageDataEnabled] = useState(false);
|
||||
const [pageDataDataset, setPageDataDataset] = useState('');
|
||||
const [pageDataRead, setPageDataRead] = useState(false);
|
||||
const [pageDataInsert, setPageDataInsert] = useState(true);
|
||||
const [pageDataUpdate, setPageDataUpdate] = useState(false);
|
||||
const [pageDataSoftDelete, setPageDataSoftDelete] = useState(false);
|
||||
const [pageDataDatasets, setPageDataDatasets] = useState<PageDataDatasetSummary[]>([]);
|
||||
const [pageDataDatasetsLoading, setPageDataDatasetsLoading] = useState(false);
|
||||
const [pageDataDatasetsError, setPageDataDatasetsError] = useState<string | null>(null);
|
||||
const [plazaCategories, setPlazaCategories] = useState<PlazaCategory[]>([]);
|
||||
const [plazaCategoryId, setPlazaCategoryId] = useState('');
|
||||
const [plazaTags, setPlazaTags] = useState('');
|
||||
@@ -292,6 +322,67 @@ export function MindSpacePageDetail({
|
||||
const [confirmPublicationStatusOpen, setConfirmPublicationStatusOpen] = useState(false);
|
||||
const [statusConfirming, setStatusConfirming] = useState(false);
|
||||
|
||||
useEffect(() => {
|
||||
if (!publishOpen) return;
|
||||
let cancelled = false;
|
||||
setPageDataDatasetsLoading(true);
|
||||
setPageDataDatasetsError(null);
|
||||
void listPageDataDatasets()
|
||||
.then((datasets) => {
|
||||
if (cancelled) return;
|
||||
setPageDataDatasets(datasets);
|
||||
setPageDataDataset((current) => current || datasets[0]?.name || '');
|
||||
})
|
||||
.catch((err) => {
|
||||
if (cancelled) return;
|
||||
setPageDataDatasetsError(err instanceof Error ? err.message : '加载 dataset 失败');
|
||||
})
|
||||
.finally(() => {
|
||||
if (!cancelled) setPageDataDatasetsLoading(false);
|
||||
});
|
||||
return () => {
|
||||
cancelled = true;
|
||||
};
|
||||
}, [publishOpen]);
|
||||
|
||||
useEffect(() => {
|
||||
if (!publishOpen || !page?.id) return;
|
||||
let cancelled = false;
|
||||
void getPageDataPolicy(page.id)
|
||||
.then((policy) => {
|
||||
if (cancelled || !policy) return;
|
||||
const datasetNames = Object.keys(policy.datasets ?? {});
|
||||
if (datasetNames.length === 0) return;
|
||||
const primaryDataset = datasetNames[0];
|
||||
const datasetPolicy = policy.datasets[primaryDataset];
|
||||
if (!datasetPolicy) return;
|
||||
setPageDataEnabled(true);
|
||||
setPageDataDataset(primaryDataset);
|
||||
setPageDataRead(Boolean(datasetPolicy.read));
|
||||
setPageDataInsert(Boolean(datasetPolicy.insert));
|
||||
setPageDataUpdate(Boolean(datasetPolicy.update));
|
||||
setPageDataSoftDelete(Boolean(datasetPolicy.softDelete));
|
||||
})
|
||||
.catch(() => {
|
||||
// 无策略时保持默认关闭
|
||||
});
|
||||
return () => {
|
||||
cancelled = true;
|
||||
};
|
||||
}, [publishOpen, page?.id]);
|
||||
|
||||
useEffect(() => {
|
||||
if (!PAGE_DATA_PUBLISH_MODES.has(accessMode)) {
|
||||
setPageDataEnabled(false);
|
||||
return;
|
||||
}
|
||||
const defaults = defaultPageDataCapabilities(accessMode);
|
||||
setPageDataRead(defaults.read);
|
||||
setPageDataInsert(defaults.insert);
|
||||
setPageDataUpdate(defaults.update);
|
||||
setPageDataSoftDelete(defaults.softDelete);
|
||||
}, [accessMode]);
|
||||
|
||||
const applyPageRecord = useCallback(
|
||||
(next: MindSpacePage, options?: { recordHistory?: boolean }) => {
|
||||
setPage(next);
|
||||
@@ -427,6 +518,20 @@ export function MindSpacePageDetail({
|
||||
password: accessPassword || undefined,
|
||||
expiresAt: expiresAt ? new Date(expiresAt).getTime() : null,
|
||||
});
|
||||
if (pageDataEnabled && PAGE_DATA_PUBLISH_MODES.has(accessMode)) {
|
||||
if (!pageDataDataset) {
|
||||
throw new Error('已启用页面数据,请先选择 dataset');
|
||||
}
|
||||
await applyPageDataPublishPolicy(page.id, {
|
||||
datasetName: pageDataDataset,
|
||||
capabilities: {
|
||||
read: pageDataRead,
|
||||
insert: pageDataInsert,
|
||||
update: pageDataUpdate,
|
||||
softDelete: pageDataSoftDelete,
|
||||
},
|
||||
});
|
||||
}
|
||||
let nextPlazaPost: PlazaPostBrief | null = plazaPost;
|
||||
if (pushToPlaza) {
|
||||
nextPlazaPost = await publishToPlazaWithDefaults(publication.id);
|
||||
@@ -604,6 +709,11 @@ export function MindSpacePageDetail({
|
||||
const publishBlockedBySecurity = Boolean(
|
||||
publishCheck && publishCheck.findings.some((finding) => finding.blocking),
|
||||
);
|
||||
const publishPageDataBlocked = Boolean(
|
||||
pageDataEnabled &&
|
||||
PAGE_DATA_PUBLISH_MODES.has(accessMode) &&
|
||||
(pageDataDatasetsLoading || !pageDataDataset),
|
||||
);
|
||||
const publishWarningFindings =
|
||||
publishCheck?.findings.filter((finding) => !finding.blocking) ?? [];
|
||||
|
||||
@@ -1006,6 +1116,16 @@ export function MindSpacePageDetail({
|
||||
发布到广场
|
||||
</button>
|
||||
) : null}
|
||||
<button
|
||||
type="button"
|
||||
onClick={() => {
|
||||
setPageDataOpsOpen((open) => !open);
|
||||
setPlazaOpen(false);
|
||||
}}
|
||||
disabled={publishing}
|
||||
>
|
||||
页面数据
|
||||
</button>
|
||||
<button type="button" onClick={() => void offline()} disabled={publishing}>
|
||||
立即下线
|
||||
</button>
|
||||
@@ -1032,6 +1152,15 @@ export function MindSpacePageDetail({
|
||||
</div>
|
||||
) : null}
|
||||
|
||||
{pageDataOpsOpen && page.publication ? (
|
||||
<MindSpacePageDataOpsPanel
|
||||
pageId={page.id}
|
||||
pageTitle={page.title}
|
||||
accessMode={page.publication.accessMode}
|
||||
onClose={() => setPageDataOpsOpen(false)}
|
||||
/>
|
||||
) : null}
|
||||
|
||||
{plazaOpen ? (
|
||||
<section className="mindspace-publish-panel">
|
||||
<div>
|
||||
@@ -1130,6 +1259,103 @@ export function MindSpacePageDetail({
|
||||
))}
|
||||
</select>
|
||||
</label>
|
||||
{PAGE_DATA_PUBLISH_MODES.has(accessMode) ? (
|
||||
<div className="mindspace-page-data-publish-panel">
|
||||
<label className="mindspace-page-data-publish-toggle">
|
||||
<input
|
||||
type="checkbox"
|
||||
checked={pageDataEnabled}
|
||||
disabled={publishing}
|
||||
onChange={(event) => setPageDataEnabled(event.target.checked)}
|
||||
/>
|
||||
启用页面数据(Page Data API)
|
||||
</label>
|
||||
{pageDataEnabled ? (
|
||||
<>
|
||||
<label>
|
||||
绑定 dataset
|
||||
<select
|
||||
value={pageDataDataset}
|
||||
disabled={publishing || pageDataDatasetsLoading}
|
||||
onChange={(event) => setPageDataDataset(event.target.value)}
|
||||
>
|
||||
{pageDataDatasets.length === 0 ? (
|
||||
<option value="">暂无可用 dataset</option>
|
||||
) : (
|
||||
pageDataDatasets.map((dataset) => (
|
||||
<option value={dataset.name} key={dataset.name}>
|
||||
{dataset.name}
|
||||
{dataset.description ? ` · ${dataset.description}` : ''}
|
||||
</option>
|
||||
))
|
||||
)}
|
||||
</select>
|
||||
</label>
|
||||
{pageDataDatasetsLoading ? (
|
||||
<p className="mindspace-page-data-publish-hint">正在加载 dataset…</p>
|
||||
) : null}
|
||||
{pageDataDatasetsError ? (
|
||||
<p className="mindspace-page-data-ops-error">{pageDataDatasetsError}</p>
|
||||
) : null}
|
||||
{!pageDataDatasetsLoading && pageDataDatasets.length === 0 ? (
|
||||
<p className="mindspace-page-data-publish-hint">
|
||||
请先在 Agent 中注册 dataset,再发布并绑定页面数据。
|
||||
</p>
|
||||
) : null}
|
||||
<div className="mindspace-page-data-publish-capabilities">
|
||||
<span>公开能力</span>
|
||||
<label>
|
||||
<input
|
||||
type="checkbox"
|
||||
checked={pageDataRead}
|
||||
disabled={publishing}
|
||||
onChange={(event) => setPageDataRead(event.target.checked)}
|
||||
/>
|
||||
读取
|
||||
</label>
|
||||
<label>
|
||||
<input
|
||||
type="checkbox"
|
||||
checked={pageDataInsert}
|
||||
disabled={publishing}
|
||||
onChange={(event) => setPageDataInsert(event.target.checked)}
|
||||
/>
|
||||
提交
|
||||
</label>
|
||||
<label>
|
||||
<input
|
||||
type="checkbox"
|
||||
checked={pageDataUpdate}
|
||||
disabled={publishing}
|
||||
onChange={(event) => setPageDataUpdate(event.target.checked)}
|
||||
/>
|
||||
更新
|
||||
</label>
|
||||
<label>
|
||||
<input
|
||||
type="checkbox"
|
||||
checked={pageDataSoftDelete}
|
||||
disabled={publishing}
|
||||
onChange={(event) => setPageDataSoftDelete(event.target.checked)}
|
||||
/>
|
||||
软删除
|
||||
</label>
|
||||
</div>
|
||||
<p className="mindspace-page-data-publish-hint">
|
||||
发布成功后会自动写入 Page Data 策略;后续可在「页面数据」面板运维、导出与撤销访问。
|
||||
</p>
|
||||
</>
|
||||
) : (
|
||||
<p className="mindspace-page-data-publish-hint">
|
||||
若页面需要读写后台数据,可勾选启用;Agent 需先注册 dataset。
|
||||
</p>
|
||||
)}
|
||||
</div>
|
||||
) : (
|
||||
<p className="mindspace-page-data-publish-hint">
|
||||
当前访问方式不支持在发布时绑定页面数据;若页面已发布,可在「页面数据」面板单独配置。
|
||||
</p>
|
||||
)}
|
||||
{accessMode === 'password' && (
|
||||
<label>
|
||||
访问密码
|
||||
@@ -1276,7 +1502,7 @@ export function MindSpacePageDetail({
|
||||
type="button"
|
||||
className="mindspace-primary"
|
||||
onClick={() => void publish()}
|
||||
disabled={publishing || !publishCheck?.allowed}
|
||||
disabled={publishing || !publishCheck?.allowed || publishPageDataBlocked}
|
||||
>
|
||||
{publishing ? (pushToPlaza ? '发布并推送…' : '发布中…') : '确认发布'}
|
||||
</button>
|
||||
|
||||
+202
-1
@@ -8255,12 +8255,213 @@ body,
|
||||
}
|
||||
|
||||
.mindspace-publication-live,
|
||||
.mindspace-publish-panel {
|
||||
.mindspace-publish-panel,
|
||||
.mindspace-page-data-ops-panel {
|
||||
margin-bottom: 22px;
|
||||
border: 1px solid rgba(24, 33, 29, 0.12);
|
||||
border-radius: 22px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-panel {
|
||||
padding: 20px 22px;
|
||||
background: #f8fbf9;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-header {
|
||||
display: flex;
|
||||
align-items: flex-start;
|
||||
justify-content: space-between;
|
||||
gap: 16px;
|
||||
margin-bottom: 16px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-header h3 {
|
||||
margin: 4px 0;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-header small {
|
||||
color: rgba(24, 33, 29, 0.62);
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-summary {
|
||||
display: grid;
|
||||
grid-template-columns: repeat(auto-fit, minmax(120px, 1fr));
|
||||
gap: 12px;
|
||||
margin-bottom: 18px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-summary div {
|
||||
padding: 12px 14px;
|
||||
border-radius: 14px;
|
||||
background: #fff;
|
||||
border: 1px solid rgba(24, 33, 29, 0.08);
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-summary span {
|
||||
display: block;
|
||||
font-size: 12px;
|
||||
color: rgba(24, 33, 29, 0.58);
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-summary strong {
|
||||
display: block;
|
||||
margin-top: 4px;
|
||||
font-size: 20px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-section + .mindspace-page-data-ops-section {
|
||||
margin-top: 18px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-section h4 {
|
||||
margin: 0 0 10px;
|
||||
font-size: 15px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-table-wrap {
|
||||
overflow-x: auto;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-table {
|
||||
width: 100%;
|
||||
border-collapse: collapse;
|
||||
font-size: 14px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-table th,
|
||||
.mindspace-page-data-ops-table td {
|
||||
padding: 8px 10px;
|
||||
border-bottom: 1px solid rgba(24, 33, 29, 0.08);
|
||||
text-align: left;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-badge {
|
||||
margin-left: 8px;
|
||||
padding: 2px 8px;
|
||||
border-radius: 999px;
|
||||
font-size: 12px;
|
||||
color: #7a2f2f;
|
||||
background: rgba(194, 73, 73, 0.12);
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-log-list {
|
||||
margin: 0;
|
||||
padding: 0;
|
||||
list-style: none;
|
||||
display: grid;
|
||||
gap: 8px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-row-actions {
|
||||
display: flex;
|
||||
flex-wrap: wrap;
|
||||
gap: 8px;
|
||||
align-items: center;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-row-actions a {
|
||||
font-size: 13px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-log-list li {
|
||||
display: grid;
|
||||
grid-template-columns: 160px 90px 1fr auto;
|
||||
gap: 10px;
|
||||
align-items: center;
|
||||
padding: 10px 12px;
|
||||
border-radius: 12px;
|
||||
background: #fff;
|
||||
border: 1px solid rgba(24, 33, 29, 0.08);
|
||||
font-size: 13px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-log-list li button {
|
||||
margin-left: auto;
|
||||
padding: 4px 10px;
|
||||
border: 1px solid rgba(24, 33, 29, 0.16);
|
||||
border-radius: 999px;
|
||||
background: #fff;
|
||||
font-size: 12px;
|
||||
cursor: pointer;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-actions {
|
||||
display: flex;
|
||||
flex-wrap: wrap;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
margin-top: 18px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-password {
|
||||
display: flex;
|
||||
flex-wrap: wrap;
|
||||
gap: 8px;
|
||||
align-items: center;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-password input {
|
||||
min-width: 220px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-muted,
|
||||
.mindspace-page-data-ops-hint {
|
||||
color: rgba(24, 33, 29, 0.62);
|
||||
font-size: 13px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-error {
|
||||
color: #9b2c2c;
|
||||
}
|
||||
|
||||
.mindspace-page-data-ops-message {
|
||||
color: #24553f;
|
||||
}
|
||||
|
||||
.mindspace-page-data-publish-panel {
|
||||
display: grid;
|
||||
gap: 12px;
|
||||
margin: 0 0 14px;
|
||||
padding: 14px 16px;
|
||||
border: 1px solid rgba(24, 33, 29, 0.1);
|
||||
border-radius: 14px;
|
||||
background: rgba(255, 253, 248, 0.88);
|
||||
}
|
||||
|
||||
.mindspace-page-data-publish-toggle {
|
||||
display: flex;
|
||||
align-items: center;
|
||||
gap: 8px;
|
||||
font-weight: 600;
|
||||
}
|
||||
|
||||
.mindspace-page-data-publish-capabilities {
|
||||
display: flex;
|
||||
flex-wrap: wrap;
|
||||
align-items: center;
|
||||
gap: 10px 14px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-publish-capabilities > span {
|
||||
color: rgba(24, 33, 29, 0.62);
|
||||
font-size: 13px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-publish-capabilities label {
|
||||
display: inline-flex;
|
||||
align-items: center;
|
||||
gap: 6px;
|
||||
margin: 0;
|
||||
font-size: 13px;
|
||||
}
|
||||
|
||||
.mindspace-page-data-publish-hint {
|
||||
margin: 0;
|
||||
color: rgba(24, 33, 29, 0.62);
|
||||
font-size: 13px;
|
||||
line-height: 1.5;
|
||||
}
|
||||
|
||||
.mindspace-publication-live {
|
||||
display: flex;
|
||||
align-items: center;
|
||||
|
||||
@@ -601,6 +601,86 @@ export type MindSpacePublicationStats = {
|
||||
sources: Array<{ source: string; views: number }>;
|
||||
};
|
||||
|
||||
export type PageDataPolicyDataset = {
|
||||
name?: string;
|
||||
read: boolean;
|
||||
insert: boolean;
|
||||
update: boolean;
|
||||
softDelete: boolean;
|
||||
hardDelete?: boolean;
|
||||
closed?: boolean;
|
||||
closedAt?: string | null;
|
||||
columns?: Record<string, string[]>;
|
||||
rowPolicy?: { scope: 'all_rows' | 'own_rows' | 'owner_only'; ownerColumn?: string };
|
||||
};
|
||||
|
||||
export type PageDataAccessPolicy = {
|
||||
pageId: string;
|
||||
ownerUserId: string;
|
||||
accessMode: 'public' | 'password' | 'login_required';
|
||||
defaultVisitorRole?: 'deny' | 'viewer' | 'editor';
|
||||
visitors?: Record<string, 'viewer' | 'editor'>;
|
||||
datasets: Record<string, PageDataPolicyDataset>;
|
||||
updatedAt?: string;
|
||||
};
|
||||
|
||||
export type PageDataLogEntry = {
|
||||
at: string;
|
||||
pageId?: string;
|
||||
dataset?: string | null;
|
||||
action: string;
|
||||
rowId?: number | null;
|
||||
accessMode?: string;
|
||||
actor?: {
|
||||
type?: string;
|
||||
userId?: string | null;
|
||||
visitorUserId?: string | null;
|
||||
role?: string | null;
|
||||
sessionId?: string | null;
|
||||
};
|
||||
summary?: Record<string, unknown> | null;
|
||||
};
|
||||
|
||||
export type PageDataOpsOverview = {
|
||||
pageId: string;
|
||||
publication: {
|
||||
id: string;
|
||||
pageId: string;
|
||||
accessMode: string;
|
||||
status: string;
|
||||
};
|
||||
policy: PageDataAccessPolicy;
|
||||
datasets: Array<{
|
||||
name: string;
|
||||
read: boolean;
|
||||
insert: boolean;
|
||||
update: boolean;
|
||||
softDelete: boolean;
|
||||
closed: boolean;
|
||||
closedAt: string | null;
|
||||
stats: { dataset: { name: string; table: string }; total: number } | null;
|
||||
}>;
|
||||
recentLogs: PageDataLogEntry[];
|
||||
recentSubmissions: PageDataLogEntry[];
|
||||
activeSessionCount: number;
|
||||
index?: {
|
||||
pageId: string;
|
||||
accessMode: string;
|
||||
datasetCount: number;
|
||||
scopeHash: string;
|
||||
updatedAt: number;
|
||||
} | null;
|
||||
registeredDatasets?: string[];
|
||||
unconfiguredDatasets?: string[];
|
||||
};
|
||||
|
||||
export type PageDataDatasetSummary = {
|
||||
name: string;
|
||||
table: string;
|
||||
description: string;
|
||||
actions: string[];
|
||||
};
|
||||
|
||||
export type PlazaCategory = {
|
||||
id: string;
|
||||
name: string;
|
||||
|
||||
+154
-10
@@ -408,7 +408,44 @@ export function createUserDataSpaceService(options = {}) {
|
||||
return keys.map((key) => assertSafeSqlIdentifier(key, '更新字段'));
|
||||
}
|
||||
|
||||
function readRowsForDataset(dataset, { limit, offset, orderBy, orderDir } = {}) {
|
||||
function buildDatasetWhereClause(table, { includeDeleted = false, rowScope = null } = {}) {
|
||||
const parts = [];
|
||||
if (!includeDeleted && tableHasColumn(table, 'deleted_at')) {
|
||||
parts.push('deleted_at IS NULL');
|
||||
}
|
||||
if (rowScope?.whereClause) {
|
||||
parts.push(rowScope.whereClause);
|
||||
}
|
||||
return parts.length ? `WHERE ${parts.join(' AND ')}` : '';
|
||||
}
|
||||
|
||||
function readRowByIdForDataset(dataset, rowId, { rowScope = null, includeDeleted = false } = {}) {
|
||||
assertDatasetAction(dataset, 'read');
|
||||
const table = assertSafeSqlIdentifier(dataset.table, '表名');
|
||||
const id = Number(rowId);
|
||||
if (!Number.isFinite(id) || id <= 0) {
|
||||
throw Object.assign(new Error('行 id 无效'), { code: 'invalid_row_id' });
|
||||
}
|
||||
const columns = resolveReadColumns(dataset);
|
||||
const parts = [`id = ${id}`];
|
||||
if (!includeDeleted && tableHasColumn(table, 'deleted_at')) {
|
||||
parts.push('deleted_at IS NULL');
|
||||
}
|
||||
if (rowScope?.whereClause) {
|
||||
parts.push(rowScope.whereClause);
|
||||
}
|
||||
const sql = `SELECT ${columns.map((column) => `"${column}"`).join(', ')}
|
||||
FROM "${table}"
|
||||
WHERE ${parts.join(' AND ')}
|
||||
LIMIT 1`;
|
||||
const rows = runJsonQuery(sql);
|
||||
if (!rows.length) {
|
||||
throw Object.assign(new Error('无权访问该行或行不存在'), { code: 'row_not_allowed' });
|
||||
}
|
||||
return rows[0];
|
||||
}
|
||||
|
||||
function readRowsForDataset(dataset, { limit, offset, orderBy, orderDir, includeDeleted = false, rowScope = null } = {}) {
|
||||
assertDatasetAction(dataset, 'read');
|
||||
const columns = resolveReadColumns(dataset);
|
||||
const table = assertSafeSqlIdentifier(dataset.table, '表名');
|
||||
@@ -418,7 +455,7 @@ export function createUserDataSpaceService(options = {}) {
|
||||
);
|
||||
const safeLimit = Math.min(Math.max(1, Number(limit ?? maxLimit)), maxLimit);
|
||||
const safeOffset = Math.max(0, Number(offset ?? 0));
|
||||
const where = tableHasColumn(table, 'deleted_at') ? 'WHERE deleted_at IS NULL' : '';
|
||||
const where = buildDatasetWhereClause(table, { includeDeleted, rowScope });
|
||||
let orderClause = '';
|
||||
if (orderBy) {
|
||||
const column = assertSafeSqlIdentifier(orderBy, '排序字段');
|
||||
@@ -447,10 +484,10 @@ export function createUserDataSpaceService(options = {}) {
|
||||
return readRowsForDataset(dataset, options);
|
||||
}
|
||||
|
||||
function getStatsForDataset(dataset) {
|
||||
function getStatsForDataset(dataset, { rowScope = null } = {}) {
|
||||
assertDatasetAction(dataset, 'read');
|
||||
const table = assertSafeSqlIdentifier(dataset.table, '表名');
|
||||
const where = tableHasColumn(table, 'deleted_at') ? 'WHERE deleted_at IS NULL' : '';
|
||||
const where = buildDatasetWhereClause(table, { rowScope });
|
||||
const total = sqliteScalar(`SELECT COUNT(*) FROM "${table}" ${where};`);
|
||||
return { dataset: { name: dataset.name, table: dataset.table }, total };
|
||||
}
|
||||
@@ -485,7 +522,23 @@ export function createUserDataSpaceService(options = {}) {
|
||||
if (tableHasColumn(table, 'page_data_session_id') && values.page_data_session_id == null && meta.pageDataSessionId) {
|
||||
values.page_data_session_id = meta.pageDataSessionId;
|
||||
}
|
||||
const insertColumns = columns.filter((column) => values[column] !== undefined);
|
||||
if (
|
||||
meta.rowScope?.ownerColumn &&
|
||||
tableHasColumn(table, meta.rowScope.ownerColumn) &&
|
||||
values[meta.rowScope.ownerColumn] == null &&
|
||||
meta.rowScope.visitorUserId
|
||||
) {
|
||||
values[meta.rowScope.ownerColumn] = meta.rowScope.visitorUserId;
|
||||
}
|
||||
let insertColumns = columns.filter((column) => values[column] !== undefined);
|
||||
if (
|
||||
meta.rowScope?.ownerColumn &&
|
||||
tableHasColumn(table, meta.rowScope.ownerColumn) &&
|
||||
values[meta.rowScope.ownerColumn] != null &&
|
||||
!insertColumns.includes(meta.rowScope.ownerColumn)
|
||||
) {
|
||||
insertColumns.push(meta.rowScope.ownerColumn);
|
||||
}
|
||||
if (!insertColumns.length) {
|
||||
throw Object.assign(new Error('提交数据不能为空'), { code: 'invalid_payload' });
|
||||
}
|
||||
@@ -495,7 +548,12 @@ export function createUserDataSpaceService(options = {}) {
|
||||
const id = sqliteScalar('SELECT last_insert_rowid();');
|
||||
let row = { id };
|
||||
if (dataset.actions.includes('read')) {
|
||||
const readBack = readRowsForDataset(dataset, { limit: 1, orderBy: 'id', orderDir: 'desc' });
|
||||
const readBack = readRowsForDataset(dataset, {
|
||||
limit: 1,
|
||||
orderBy: 'id',
|
||||
orderDir: 'desc',
|
||||
rowScope: meta.rowScope?.whereClause ? meta.rowScope : null,
|
||||
});
|
||||
row = readBack.rows.find((item) => Number(item.id) === Number(id)) ?? readBack.rows[0] ?? row;
|
||||
} else {
|
||||
for (const column of insertColumns) {
|
||||
@@ -535,13 +593,13 @@ export function createUserDataSpaceService(options = {}) {
|
||||
if (tableHasColumn(table, 'updated_by_label') && meta.updatedByLabel && !columns.includes('updated_by_label')) {
|
||||
assignments.push(`"updated_by_label" = ${sqlLiteral(meta.updatedByLabel)}`);
|
||||
}
|
||||
const scopeClause = meta.rowScope?.whereClause ? ` AND ${meta.rowScope.whereClause}` : '';
|
||||
const deletedFilter = tableHasColumn(table, 'deleted_at') ? ' AND deleted_at IS NULL' : '';
|
||||
const sql = `UPDATE "${table}"
|
||||
SET ${assignments.join(', ')}
|
||||
WHERE id = ${id}${deletedFilter};`;
|
||||
WHERE id = ${id}${deletedFilter}${scopeClause};`;
|
||||
await executeSql(sql);
|
||||
const readBack = readRowsForDataset(dataset, { limit: 1, orderBy: 'id', orderDir: 'desc' });
|
||||
const row = readBack.rows.find((item) => Number(item.id) === id) ?? { id };
|
||||
const row = readRowByIdForDataset(dataset, id, { rowScope: meta.rowScope ?? null });
|
||||
return { dataset, row };
|
||||
}
|
||||
|
||||
@@ -559,13 +617,96 @@ export function createUserDataSpaceService(options = {}) {
|
||||
if (tableHasColumn(table, 'deleted_by')) {
|
||||
assignments.push(`deleted_by = ${sqlLiteral(meta.deletedBy ?? meta.updatedByLabel ?? 'public')}`);
|
||||
}
|
||||
const scopeClause = meta.rowScope?.whereClause ? ` AND ${meta.rowScope.whereClause}` : '';
|
||||
const sql = `UPDATE "${table}"
|
||||
SET ${assignments.join(', ')}
|
||||
WHERE id = ${id} AND deleted_at IS NULL;`;
|
||||
WHERE id = ${id} AND deleted_at IS NULL${scopeClause};`;
|
||||
await executeSql(sql);
|
||||
const verifyParts = [`id = ${id}`];
|
||||
if (meta.rowScope?.whereClause) {
|
||||
verifyParts.push(meta.rowScope.whereClause);
|
||||
}
|
||||
const deletedRow = runJsonQuery(
|
||||
`SELECT id, deleted_at FROM "${table}" WHERE ${verifyParts.join(' AND ')} LIMIT 1`,
|
||||
);
|
||||
if (!deletedRow.length || !deletedRow[0].deleted_at) {
|
||||
throw Object.assign(new Error('无权删除该行或行不存在'), { code: 'row_not_allowed' });
|
||||
}
|
||||
return { dataset, id, deleted: true };
|
||||
}
|
||||
|
||||
async function restoreSoftDeletedRowForDataset(dataset, rowId) {
|
||||
const table = assertSafeSqlIdentifier(dataset.table, '表名');
|
||||
const id = Number(rowId);
|
||||
if (!Number.isFinite(id) || id <= 0) {
|
||||
throw Object.assign(new Error('行 id 无效'), { code: 'invalid_row_id' });
|
||||
}
|
||||
if (!tableHasColumn(table, 'deleted_at')) {
|
||||
throw Object.assign(new Error('目标表不支持软删除恢复'), { code: 'restore_unsupported' });
|
||||
}
|
||||
const assignments = ['deleted_at = NULL'];
|
||||
if (tableHasColumn(table, 'deleted_by')) {
|
||||
assignments.push('deleted_by = NULL');
|
||||
}
|
||||
const sql = `UPDATE "${table}"
|
||||
SET ${assignments.join(', ')}
|
||||
WHERE id = ${id} AND deleted_at IS NOT NULL;`;
|
||||
await executeSql(sql);
|
||||
const readBack = readRowsForDataset(dataset, { limit: 1, orderBy: 'id', orderDir: 'desc', includeDeleted: true });
|
||||
const row = readBack.rows.find((item) => Number(item.id) === id) ?? { id };
|
||||
return { dataset, row, restored: true };
|
||||
}
|
||||
|
||||
async function restoreSoftDeletedRow(datasetName, rowId) {
|
||||
const dataset = getDataset(datasetName);
|
||||
if (!dataset) {
|
||||
throw Object.assign(new Error('dataset 不存在'), { code: 'dataset_not_found' });
|
||||
}
|
||||
return restoreSoftDeletedRowForDataset(dataset, rowId);
|
||||
}
|
||||
|
||||
function csvEscape(value) {
|
||||
const text = value == null ? '' : String(value);
|
||||
if (/[",\n\r]/.test(text)) return `"${text.replace(/"/g, '""')}"`;
|
||||
return text;
|
||||
}
|
||||
|
||||
function exportRowsAsCsv(rows, columns) {
|
||||
const header = columns.join(',');
|
||||
const body = rows.map((row) => columns.map((column) => csvEscape(row[column])).join(','));
|
||||
return `${header}\n${body.join('\n')}\n`;
|
||||
}
|
||||
|
||||
function exportDatasetRows(datasetName, { format = 'json', includeDeleted = false, limit = 1000 } = {}) {
|
||||
const dataset = getDataset(datasetName);
|
||||
if (!dataset) {
|
||||
throw Object.assign(new Error('dataset 不存在'), { code: 'dataset_not_found' });
|
||||
}
|
||||
assertDatasetAction(dataset, 'read');
|
||||
const exportLimit = Math.min(Math.max(1, Number(limit ?? 1000)), 5000);
|
||||
const result = readRowsForDataset(dataset, {
|
||||
limit: exportLimit,
|
||||
offset: 0,
|
||||
includeDeleted: Boolean(includeDeleted),
|
||||
});
|
||||
const normalizedFormat = String(format ?? 'json').toLowerCase();
|
||||
if (normalizedFormat === 'csv') {
|
||||
const columns = resolveReadColumns(dataset);
|
||||
return {
|
||||
dataset: dataset.name,
|
||||
format: 'csv',
|
||||
content: exportRowsAsCsv(result.rows, columns),
|
||||
rowCount: result.rows.length,
|
||||
};
|
||||
}
|
||||
return {
|
||||
dataset: dataset.name,
|
||||
format: 'json',
|
||||
rows: result.rows,
|
||||
rowCount: result.rows.length,
|
||||
};
|
||||
}
|
||||
|
||||
function getSchemaForDataset(dataset) {
|
||||
const tableColumns = listTableColumns(dataset.table);
|
||||
return {
|
||||
@@ -612,6 +753,9 @@ export function createUserDataSpaceService(options = {}) {
|
||||
insertRowForDataset,
|
||||
updateRowForDataset,
|
||||
softDeleteRowForDataset,
|
||||
restoreSoftDeletedRowForDataset,
|
||||
restoreSoftDeletedRow,
|
||||
exportDatasetRows,
|
||||
getDatasetSchema,
|
||||
getSchemaForDataset,
|
||||
};
|
||||
|
||||
@@ -137,3 +137,90 @@ test('user-data-space-service supports update and soft delete', async () => {
|
||||
const listed = service.readDatasetRows('tasks', { limit: 10 });
|
||||
assert.equal(listed.rows.length, 0);
|
||||
});
|
||||
|
||||
test('exportDatasetRows supports json and csv output', async () => {
|
||||
const workspaceRoot = createTempWorkspace();
|
||||
const service = createUserDataSpaceService({ workspaceRoot });
|
||||
await service.executeSql(`CREATE TABLE contacts (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
name TEXT NOT NULL,
|
||||
phone TEXT
|
||||
);`);
|
||||
await service.upsertDataset({
|
||||
name: 'contacts',
|
||||
table: 'contacts',
|
||||
actions: ['read', 'insert'],
|
||||
columns: {
|
||||
read: ['id', 'name', 'phone'],
|
||||
insert: ['name', 'phone'],
|
||||
},
|
||||
});
|
||||
await service.insertDatasetRow('contacts', { name: '李四', phone: '13900000002' });
|
||||
const json = service.exportDatasetRows('contacts', { format: 'json' });
|
||||
assert.equal(json.rowCount, 1);
|
||||
assert.equal(json.rows[0].name, '李四');
|
||||
const csv = service.exportDatasetRows('contacts', { format: 'csv' });
|
||||
assert.match(csv.content, /name,phone/);
|
||||
assert.match(csv.content, /李四/);
|
||||
});
|
||||
|
||||
test('restoreSoftDeletedRow clears deleted_at', async () => {
|
||||
const workspaceRoot = createTempWorkspace();
|
||||
const service = createUserDataSpaceService({ workspaceRoot });
|
||||
await service.executeSql(`CREATE TABLE items (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
title TEXT NOT NULL,
|
||||
deleted_at TEXT,
|
||||
deleted_by TEXT
|
||||
);`);
|
||||
await service.upsertDataset({
|
||||
name: 'items',
|
||||
table: 'items',
|
||||
actions: ['read', 'insert', 'soft_delete'],
|
||||
columns: {
|
||||
read: ['id', 'title', 'deleted_at'],
|
||||
insert: ['title'],
|
||||
soft_delete: ['id'],
|
||||
},
|
||||
});
|
||||
const inserted = await service.insertDatasetRow('items', { title: '可恢复项' });
|
||||
await service.softDeleteRowForDataset(service.getDataset('items'), inserted.row.id, { deletedBy: 'test' });
|
||||
const hidden = service.readDatasetRows('items', { limit: 10 });
|
||||
assert.equal(hidden.rows.length, 0);
|
||||
const restored = await service.restoreSoftDeletedRow('items', inserted.row.id);
|
||||
assert.equal(restored.restored, true);
|
||||
const visible = service.readDatasetRows('items', { limit: 10 });
|
||||
assert.equal(visible.rows.length, 1);
|
||||
assert.equal(visible.rows[0].title, '可恢复项');
|
||||
});
|
||||
|
||||
test('readRowsForDataset applies rowScope where clause', async () => {
|
||||
const workspaceRoot = createTempWorkspace();
|
||||
const service = createUserDataSpaceService({ workspaceRoot });
|
||||
await service.executeSql(`CREATE TABLE scoped_items (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
title TEXT NOT NULL,
|
||||
created_by_user_id TEXT
|
||||
);`);
|
||||
await service.upsertDataset({
|
||||
name: 'scoped_items',
|
||||
table: 'scoped_items',
|
||||
actions: ['read', 'insert'],
|
||||
columns: {
|
||||
read: ['id', 'title', 'created_by_user_id'],
|
||||
insert: ['title'],
|
||||
},
|
||||
});
|
||||
await service.insertRowForDataset(service.getDataset('scoped_items'), { title: 'A' }, {
|
||||
rowScope: { ownerColumn: 'created_by_user_id', visitorUserId: 'user-a' },
|
||||
});
|
||||
await service.insertRowForDataset(service.getDataset('scoped_items'), { title: 'B' }, {
|
||||
rowScope: { ownerColumn: 'created_by_user_id', visitorUserId: 'user-b' },
|
||||
});
|
||||
const scoped = service.readRowsForDataset(service.getDataset('scoped_items'), {
|
||||
limit: 10,
|
||||
rowScope: { whereClause: `"created_by_user_id" = 'user-a'` },
|
||||
});
|
||||
assert.equal(scoped.rows.length, 1);
|
||||
assert.equal(scoped.rows[0].title, 'A');
|
||||
});
|
||||
|
||||
Reference in New Issue
Block a user