Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
D
dify
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ai-tech
dify
Commits
c67ecff3
Unverified
Commit
c67ecff3
authored
Jun 27, 2023
by
Jyong
Committed by
GitHub
Jun 27, 2023
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Fix/json format (#465)
parent
d5b42c09
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
13 additions
and
2 deletions
+13
-2
excel.py
api/core/data_loader/loader/excel.py
+3
-2
notion.py
api/core/data_loader/loader/notion.py
+10
-0
No files found.
api/core/data_loader/loader/excel.py
View file @
c67ecff3
...
...
@@ -36,8 +36,9 @@ class ExcelLoader(BaseLoader):
if
keys
==
[]:
keys
=
list
(
map
(
str
,
row
))
else
:
row_dict
=
dict
(
zip
(
keys
,
row
))
row_dict
=
dict
(
zip
(
keys
,
list
(
map
(
str
,
row
))
))
row_dict
=
{
k
:
v
for
k
,
v
in
row_dict
.
items
()
if
v
}
data
.
append
(
json
.
dumps
(
row_dict
,
ensure_ascii
=
False
))
item
=
''
.
join
(
f
'{k}:{v}
\n
'
for
k
,
v
in
row_dict
.
items
())
data
.
append
(
item
)
return
[
Document
(
page_content
=
'
\n\n
'
.
join
(
data
))]
api/core/data_loader/loader/notion.py
View file @
c67ecff3
...
...
@@ -134,6 +134,16 @@ class NotionLoader(BaseLoader):
else
:
value
=
property_value
[
type
]
data
[
property_name
]
=
value
row_dict
=
{
k
:
v
for
k
,
v
in
data
.
items
()
if
v
}
row_content
=
''
for
key
,
value
in
row_dict
.
items
():
if
isinstance
(
value
,
dict
):
value_dict
=
{
k
:
v
for
k
,
v
in
value
.
items
()
if
v
}
value_content
=
''
.
join
(
f
'{k}:{v} '
for
k
,
v
in
value_dict
.
items
())
row_content
=
row_content
+
f
'{key}:{value_content}
\n
'
else
:
row_content
=
row_content
+
f
'{key}:{value}
\n
'
database_content_list
.
append
(
row_content
)
database_content_list
.
append
(
json
.
dumps
(
data
,
ensure_ascii
=
False
))
return
"
\n\n
"
.
join
(
database_content_list
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment