
* fix scraping failure with wepb image (merge upstream/fix-webp-scrape) * add filetype to requirements * add proxycrawl.com as fallback for douban scraper * load 3p js/css from cdn * add fix-cover task * fix book/album cover tasks * scrapestack * bandcamp scrape and preview ; manage.py scrape <url> ; make ^C work when DEBUG * use scrapestack when fix cover * add user agent to improve compatibility * search BandCamp for music albums * add missing MovieGenre * fix search 500 when song has no parent album * adjust timeout * individual scrapers * fix tmdb parser * export marks via rq; pref to send public toot; move import to data page * fix spotify import * fix edge cases * export: fix dupe tags * use rq to manage doufen import * add django command to manage rq jobs * fix export edge case * tune rq admin * fix detail page 502 step 1: async pull mastodon follow/block/mute list * fix detail page 502 step 2: calculate relationship by local cached data * manual sync mastodon follow info * domain_blocks parsing fix * marks by who i follows * adjust label * use username in urls * add page to list a user\'s review * review widget on user home page * fix preview 500 * fix typo * minor fix * fix google books parsing * allow mark/review visible to oneself * fix auto sync masto for new user * fix search 500 * add command to restart a sync task * reset visibility * delete user data * fix tag search result pagination * not upgrade to django 4 yet * basic doc * wip: collection * wip * wip * collection use htmx * show in-collection section for entities * fix typo * add su for easier debug * fix some 500s * fix login using alternative domain * hide data from disabled user * add item to list from detail page * my tags * collection: inline comment edit * show number of ratings * fix collection delete * more detail in collection view * use item template in search result * fix 500 * write index to meilisearch * fix search * reindex in batch * fix 500 * show search result from meilisearch * more search commands * index less fields * index new items only * search highlights * fix 500 * auto set search category * classic search if no meili server * fix index stats error * support typesense backend * workaround typesense bug * make external search async * fix 500, typo * fix cover scripts * fix minor issue in douban parser * supports m.douban.com and customized bandcamp domain * move account * reword with gender-friendly and instance-neutral language * Friendica does not have vapid_key in api response * enable anonymous search * tweak book result template * API v0 API v0 * fix meilisearch reindex * fix search by url error * login via twitter.com * login via pixelfed * minor fix * no refresh on inactive users * support refresh access token * get rid of /users/number-id/ * refresh twitter handler automatically * paste image when review * support PixelFed (very long token) * fix django-markdownx version * ignore single quote for meilisearch for now * update logo * show book review/mark from same isbn * show movie review/mark from same imdb * fix login with older mastodon servers * import Goodreads book list and profile * add timestamp to Goodreads import * support new google books api * import goodreads list * minor goodreads fix * click corner action icon to add to wishlist * clean up duplicated code * fix anonymous search * fix 500 * minor fix search 500 * show rating only if votes > 5 * Entity.refresh_rating() * preference to append text when sharing; clean up duplicated code * fix missing data for user tagged view * fix page link for tag view * fix 500 when language field longer than 10 * fix 500 when sharing mark for song * fix error when reimport goodread profile * fix minor typo * fix a rare 500 * error log dump less * fix tags in marks export * fix missing param in pagination * import douban review * clarify text * fix missing sheet in review import * review: show in progress * scrape douban: ignore unknown genre * minor fix * improve review import by guess entity urls * clear guide text for review import * improve review import form text * workaround some 500 * fix mark import error * fix img in review import * load external results earlier * ignore search server errors * simplify user register flow to avoid inconsistent state * Add a learn more link on login page * Update login.html * show mark created timestamp as mark time * no 500 for api error * redirect for expired tokens * ensure preference object created. * mark collections * tag list * fix tag display * fix sorting etc * fix 500 * fix potential export 500; save shared links * fix share to twittwe * fix review url * fix 500 * fix 500 * add timeline, etc * missing status change in timeline * missing id in timeline * timeline view by default * workaround bug in markdownx... * fix typo * option to create new collection when add from detail page * add missing announcement and tags in timeline home * add missing announcement * add missing announcement * opensearch * show fediverse shared link * public review no longer requires login * fix markdownx bug * fix 500 * use cloudflare cdn * validate jquery load and domain input * fix 500 * tips for goodreads import * collaborative collection * show timeline and profile link on nav bar * minor tweak * share collection * fix Goodreads search * show wish mark in timeline * resync failed urls with local proxy * resync failed urls with local proxy: check proxy first * scraper minor fix * resync failed urls * fix fields limit * fix douban parsing error * resync * scraper minor fix * scraper minor fix * scraper minor fix * local proxy * local proxy * sync default config from neodb * configurable site name * fix 500 * fix 500 for anonymous user * add sentry * add git version in log * add git version in log * no longer rely on cdnjs.cloudflare.com * move jq/cash to _common_libs template partial * fix rare js error * fix 500 * avoid double submission error * import tag in lower case * catch some js network errors * catch some js network errors * support more goodread urls * fix unaired tv in tmdb * support more google book urls * fix related series * more goodreads urls * robust googlebooks search * robust search * Update settings.py * Update scraper.py * Update requirements.txt * make nicedb work * doc update * simplify permission check * update doc * update doc for bug report link * skip spotify tracks * fix 500 * improve search api * blind fix import compatibility * show years for movie in timeline * show years for movie in timeline; thinner font * export reviews * revert user home to use jquery https://github.com/fabiospampinato/cash/issues/246 * IGDB * use IGDB for Steam * use TMDB for IMDb * steam: igdb then fallback to steam * keep change history * keep change history: add django settings * Steam: keep localized title/brief while merging IGDB * basic Docker support * rescrape * Create codeql-analysis.yml * Create SECURITY.md * Create pysa.yml Co-authored-by: doubaniux <goodsir@vivaldi.net> Co-authored-by: Your Name <you@example.com> Co-authored-by: Their Name <they@example.com> Co-authored-by: Mt. Front <mfcndw@gmail.com>
442 lines
15 KiB
Python
442 lines
15 KiB
Python
import logging
|
|
from django.shortcuts import render, get_object_or_404, redirect, reverse
|
|
from django.contrib.auth.decorators import login_required, permission_required
|
|
from django.utils.translation import gettext_lazy as _
|
|
from django.http import HttpResponseBadRequest, HttpResponseServerError, HttpResponse
|
|
from django.core.exceptions import ObjectDoesNotExist, PermissionDenied
|
|
from django.db import IntegrityError, transaction
|
|
from django.db.models import Count
|
|
from django.utils import timezone
|
|
from django.core.paginator import Paginator
|
|
from mastodon import mastodon_request_included
|
|
from mastodon.models import MastodonApplication
|
|
from mastodon.api import post_toot, TootVisibilityEnum, share_collection
|
|
from common.utils import PageLinksGenerator
|
|
from common.views import PAGE_LINK_NUMBER, jump_or_scrape, go_relogin
|
|
from common.models import SourceSiteEnum
|
|
from .models import *
|
|
from .forms import *
|
|
from django.conf import settings
|
|
import re
|
|
from users.models import User
|
|
from django.http import HttpResponseRedirect
|
|
|
|
|
|
logger = logging.getLogger(__name__)
|
|
mastodon_logger = logging.getLogger("django.mastodon")
|
|
|
|
|
|
# how many marks showed on the detail page
|
|
MARK_NUMBER = 5
|
|
# how many marks at the mark page
|
|
MARK_PER_PAGE = 20
|
|
# how many reviews showed on the detail page
|
|
REVIEW_NUMBER = 5
|
|
# how many reviews at the mark page
|
|
REVIEW_PER_PAGE = 20
|
|
# max tags on detail page
|
|
TAG_NUMBER = 10
|
|
|
|
|
|
class HTTPResponseHXRedirect(HttpResponseRedirect):
|
|
def __init__(self, *args, **kwargs):
|
|
super().__init__(*args, **kwargs)
|
|
self['HX-Redirect'] = self['Location']
|
|
status_code = 200
|
|
|
|
|
|
# public data
|
|
###########################
|
|
@login_required
|
|
def create(request):
|
|
if request.method == 'GET':
|
|
form = CollectionForm()
|
|
return render(
|
|
request,
|
|
'create_update.html',
|
|
{
|
|
'form': form,
|
|
'title': _('添加收藏单'),
|
|
'submit_url': reverse("collection:create"),
|
|
# provided for frontend js
|
|
'this_site_enum_value': SourceSiteEnum.IN_SITE.value,
|
|
}
|
|
)
|
|
elif request.method == 'POST':
|
|
if request.user.is_authenticated:
|
|
# only local user can alter public data
|
|
form = CollectionForm(request.POST, request.FILES)
|
|
form.instance.owner = request.user
|
|
if form.is_valid():
|
|
form.instance.last_editor = request.user
|
|
try:
|
|
with transaction.atomic():
|
|
form.save()
|
|
except IntegrityError as e:
|
|
logger.error(e.__str__())
|
|
return HttpResponseServerError("integrity error")
|
|
return redirect(reverse("collection:retrieve", args=[form.instance.id]))
|
|
else:
|
|
return render(
|
|
request,
|
|
'create_update.html',
|
|
{
|
|
'form': form,
|
|
'title': _('添加收藏单'),
|
|
'submit_url': reverse("collection:create"),
|
|
# provided for frontend js
|
|
'this_site_enum_value': SourceSiteEnum.IN_SITE.value,
|
|
}
|
|
)
|
|
else:
|
|
return redirect(reverse("users:login"))
|
|
else:
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
@login_required
|
|
def update(request, id):
|
|
page_title = _("修改收藏单")
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if not collection.is_visible_to(request.user):
|
|
raise PermissionDenied()
|
|
if request.method == 'GET':
|
|
form = CollectionForm(instance=collection)
|
|
return render(
|
|
request,
|
|
'create_update.html',
|
|
{
|
|
'form': form,
|
|
'is_update': True,
|
|
'title': page_title,
|
|
'submit_url': reverse("collection:update", args=[collection.id]),
|
|
# provided for frontend js
|
|
'this_site_enum_value': SourceSiteEnum.IN_SITE.value,
|
|
}
|
|
)
|
|
elif request.method == 'POST':
|
|
form = CollectionForm(request.POST, request.FILES, instance=collection)
|
|
if form.is_valid():
|
|
form.instance.last_editor = request.user
|
|
form.instance.edited_time = timezone.now()
|
|
try:
|
|
with transaction.atomic():
|
|
form.save()
|
|
except IntegrityError as e:
|
|
logger.error(e.__str__())
|
|
return HttpResponseServerError("integrity error")
|
|
else:
|
|
return render(
|
|
request,
|
|
'create_update.html',
|
|
{
|
|
'form': form,
|
|
'is_update': True,
|
|
'title': page_title,
|
|
'submit_url': reverse("collection:update", args=[collection.id]),
|
|
# provided for frontend js
|
|
'this_site_enum_value': SourceSiteEnum.IN_SITE.value,
|
|
}
|
|
)
|
|
return redirect(reverse("collection:retrieve", args=[form.instance.id]))
|
|
|
|
else:
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
@mastodon_request_included
|
|
# @login_required
|
|
def retrieve(request, id):
|
|
if request.method == 'GET':
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if not collection.is_visible_to(request.user):
|
|
raise PermissionDenied()
|
|
form = CollectionForm(instance=collection)
|
|
|
|
if request.user.is_authenticated:
|
|
following = True if CollectionMark.objects.filter(owner=request.user, collection=collection).first() is not None else False
|
|
followers = []
|
|
else:
|
|
following = False
|
|
followers = []
|
|
|
|
return render(
|
|
request,
|
|
'detail.html',
|
|
{
|
|
'collection': collection,
|
|
'form': form,
|
|
'editable': request.user.is_authenticated and collection.is_editable_by(request.user),
|
|
'followers': followers,
|
|
'following': following,
|
|
}
|
|
)
|
|
else:
|
|
logger.warning('non-GET method at /collections/<id>')
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
@mastodon_request_included
|
|
# @login_required
|
|
def retrieve_entity_list(request, id):
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if not collection.is_visible_to(request.user):
|
|
raise PermissionDenied()
|
|
form = CollectionForm(instance=collection)
|
|
|
|
followers = []
|
|
if request.user.is_authenticated:
|
|
followers = []
|
|
|
|
return render(
|
|
request,
|
|
'entity_list.html',
|
|
{
|
|
'collection': collection,
|
|
'form': form,
|
|
'editable': request.user.is_authenticated and collection.is_editable_by(request.user),
|
|
'followers': followers,
|
|
|
|
}
|
|
)
|
|
|
|
|
|
@login_required
|
|
def delete(request, id):
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if request.user.is_staff or request.user == collection.owner:
|
|
if request.method == 'GET':
|
|
return render(
|
|
request,
|
|
'delete.html',
|
|
{
|
|
'collection': collection,
|
|
'form': CollectionForm(instance=collection)
|
|
}
|
|
)
|
|
elif request.method == 'POST':
|
|
collection.delete()
|
|
return redirect(reverse("common:home"))
|
|
else:
|
|
raise PermissionDenied()
|
|
|
|
|
|
@login_required
|
|
def wish(request, id):
|
|
try:
|
|
CollectionMark.objects.create(owner=request.user, collection=Collection.objects.get(id=id))
|
|
except Exception:
|
|
pass
|
|
return HttpResponse("✔️")
|
|
|
|
|
|
@login_required
|
|
def follow(request, id):
|
|
CollectionMark.objects.create(owner=request.user, collection=Collection.objects.get(id=id))
|
|
return redirect(reverse("collection:retrieve", args=[id]))
|
|
|
|
|
|
@login_required
|
|
def unfollow(request, id):
|
|
CollectionMark.objects.filter(owner=request.user, collection=Collection.objects.get(id=id)).delete()
|
|
return redirect(reverse("collection:retrieve", args=[id]))
|
|
|
|
|
|
@login_required
|
|
def list(request, user_id=None, marked=False):
|
|
if request.method == 'GET':
|
|
user = request.user if user_id is None else User.objects.get(id=user_id)
|
|
if marked:
|
|
title = user.mastodon_username + _('关注的收藏单')
|
|
queryset = Collection.objects.filter(pk__in=CollectionMark.objects.filter(owner=user).values_list('collection', flat=True))
|
|
else:
|
|
title = user.mastodon_username + _('创建的收藏单')
|
|
queryset = Collection.objects.filter(owner=user)
|
|
paginator = Paginator(queryset, REVIEW_PER_PAGE)
|
|
page_number = request.GET.get('page', default=1)
|
|
collections = paginator.get_page(page_number)
|
|
collections.pagination = PageLinksGenerator(
|
|
PAGE_LINK_NUMBER, page_number, paginator.num_pages)
|
|
return render(
|
|
request,
|
|
'list.html',
|
|
{
|
|
'collections': collections,
|
|
'title': title,
|
|
}
|
|
)
|
|
else:
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
def get_entity_by_url(url):
|
|
m = re.findall(r'^/?(movies|books|games|music/album|music/song)/(\d+)/?', url.strip().lower().replace(settings.APP_WEBSITE.lower(), ''))
|
|
if len(m) > 0:
|
|
mapping = {
|
|
'movies': Movie,
|
|
'books': Book,
|
|
'games': Game,
|
|
'music/album': Album,
|
|
'music/song': Song,
|
|
}
|
|
cls = mapping.get(m[0][0])
|
|
id = int(m[0][1])
|
|
if cls is not None:
|
|
return cls.objects.get(id=id)
|
|
return None
|
|
|
|
|
|
@login_required
|
|
def append_item(request, id):
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if request.method == 'POST' and collection.is_editable_by(request.user):
|
|
url = request.POST.get('url')
|
|
comment = request.POST.get('comment')
|
|
item = get_entity_by_url(url)
|
|
collection.append_item(item, comment)
|
|
collection.save()
|
|
# return redirect(reverse("collection:retrieve", args=[id]))
|
|
return retrieve_entity_list(request, id)
|
|
else:
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
@login_required
|
|
def delete_item(request, id, item_id):
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if request.method == 'POST' and collection.is_editable_by(request.user):
|
|
# item_id = int(request.POST.get('item_id'))
|
|
item = CollectionItem.objects.get(id=item_id)
|
|
if item is not None and item.collection == collection:
|
|
item.delete()
|
|
# collection.save()
|
|
# return HTTPResponseHXRedirect(redirect_to=reverse("collection:retrieve", args=[id]))
|
|
return retrieve_entity_list(request, id)
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
@login_required
|
|
def move_up_item(request, id, item_id):
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if request.method == 'POST' and collection.is_editable_by(request.user):
|
|
# item_id = int(request.POST.get('item_id'))
|
|
item = CollectionItem.objects.get(id=item_id)
|
|
if item is not None and item.collection == collection:
|
|
items = collection.collectionitem_list
|
|
idx = items.index(item)
|
|
if idx > 0:
|
|
o = items[idx - 1]
|
|
p = o.position
|
|
o.position = item.position
|
|
item.position = p
|
|
o.save()
|
|
item.save()
|
|
# collection.save()
|
|
# return HTTPResponseHXRedirect(redirect_to=reverse("collection:retrieve", args=[id]))
|
|
return retrieve_entity_list(request, id)
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
@login_required
|
|
def move_down_item(request, id, item_id):
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if request.method == 'POST' and collection.is_editable_by(request.user):
|
|
# item_id = int(request.POST.get('item_id'))
|
|
item = CollectionItem.objects.get(id=item_id)
|
|
if item is not None and item.collection == collection:
|
|
items = collection.collectionitem_list
|
|
idx = items.index(item)
|
|
if idx + 1 < len(items):
|
|
o = items[idx + 1]
|
|
p = o.position
|
|
o.position = item.position
|
|
item.position = p
|
|
o.save()
|
|
item.save()
|
|
# collection.save()
|
|
# return HTTPResponseHXRedirect(redirect_to=reverse("collection:retrieve", args=[id]))
|
|
return retrieve_entity_list(request, id)
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
def show_item_comment(request, id, item_id):
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
item = CollectionItem.objects.get(id=item_id)
|
|
editable = request.user.is_authenticated and collection.is_editable_by(request.user)
|
|
return render(request, 'show_item_comment.html', {'collection': collection, 'collectionitem': item, 'editable': editable})
|
|
|
|
|
|
@login_required
|
|
def update_item_comment(request, id, item_id):
|
|
collection = get_object_or_404(Collection, pk=id)
|
|
if collection.is_editable_by(request.user):
|
|
# item_id = int(request.POST.get('item_id'))
|
|
item = CollectionItem.objects.get(id=item_id)
|
|
if item is not None and item.collection == collection:
|
|
if request.method == 'POST':
|
|
item.comment = request.POST.get('comment', default='')
|
|
item.save()
|
|
return render(request, 'show_item_comment.html', {'collection': collection, 'collectionitem': item, 'editable': True})
|
|
else:
|
|
return render(request, 'edit_item_comment.html', {'collection': collection, 'collectionitem': item})
|
|
return retrieve_entity_list(request, id)
|
|
return HttpResponseBadRequest()
|
|
|
|
|
|
@login_required
|
|
def list_with(request, type, id):
|
|
pass
|
|
|
|
|
|
def get_entity_by_type_id(type, id):
|
|
mapping = {
|
|
'movie': Movie,
|
|
'book': Book,
|
|
'game': Game,
|
|
'album': Album,
|
|
'song': Song,
|
|
}
|
|
cls = mapping.get(type)
|
|
if cls is not None:
|
|
return cls.objects.get(id=id)
|
|
return None
|
|
|
|
|
|
@login_required
|
|
def add_to_list(request, type, id):
|
|
item = get_entity_by_type_id(type, id)
|
|
if request.method == 'GET':
|
|
queryset = Collection.objects.filter(owner=request.user)
|
|
return render(
|
|
request,
|
|
'add_to_list.html',
|
|
{
|
|
'type': type,
|
|
'id': id,
|
|
'item': item,
|
|
'collections': queryset,
|
|
}
|
|
)
|
|
else:
|
|
cid = int(request.POST.get('collection_id', default=0))
|
|
if not cid:
|
|
cid = Collection.objects.create(owner=request.user, title=f'{request.user.username}的收藏单').id
|
|
collection = Collection.objects.filter(owner=request.user, id=cid).first()
|
|
collection.append_item(item, request.POST.get('comment'))
|
|
return HttpResponseRedirect(request.META.get('HTTP_REFERER'))
|
|
|
|
|
|
@login_required
|
|
def share(request, id):
|
|
collection = Collection.objects.filter(id=id).first()
|
|
if not collection:
|
|
return HttpResponseBadRequest()
|
|
if request.method == 'GET':
|
|
return render(request, 'share_collection.html', {'id': id, 'visibility': request.user.get_preference().default_visibility})
|
|
else:
|
|
visibility = int(request.POST.get('visibility', default=0))
|
|
comment = request.POST.get('comment')
|
|
if share_collection(collection, comment, request.user, visibility):
|
|
return HttpResponseRedirect(request.META.get('HTTP_REFERER'))
|
|
else:
|
|
return go_relogin(request)
|