Create an all_sentences_with_audio.tar.bz2, or put all sentences with audio in sentences_with_audio.tar.bz2 . #2955
Labels
enhancement
Issue that describes a problem that requires a change in the current functionalities of Tatoeba.
Milestone
Comments
ckjpn
added
the
enhancement
|
I apologize for all the trouble caused because of that change. I think it’s fine to include all audios back in the export file. The rationale behind this change was that audio that cannot be reused outside Tatoeba don’t need to be exported, but I didn’t think about reusing the metadata instead. We can just revert most of #2937. |
jiru
added a commit
that referenced
this issue
Jun 19, 2022
This reverts commits 09f39fd and 63c3170. The rationale behind the original change was that audio that cannot be reused outside Tatoeba don’t need to be exported, but I didn’t think about reusing the metadata instead. It turns out I broke some of our members’ workflow, so I’m reverting. Solves #2955.
|
Next Saturday’s export will include all sentences with audio, like it used to be. |
|
I'm not sure if this is a problem, but I thought you'd like to know.
Normally, files are uploaded within a minute or two.
The last few imports took much longer.
For example, it's been 19 minutes and this still hasn't been uploaded.
Message ID: ***@***.***>
… |
|
@ckjpn Did the audio get uploaded after all? I'm not seeing any audio to import on https://tatoeba.org/en/audio/import. FYI there's been a Tatoeba update today that impacts audio uploads among other things (#2929). When I deployed the changes, there was some issues at first that I didn't notice right away. I needed to run some database migration but wasn't aware. I found out later on and fixed the issues. Perhaps you tried to upload the audio files while it was not fixed yet. |
|
I just uploaded 2 more audio files, and it's been over 3 minutes and they
still haven't been uploaded.
Before, it was just a matter of seconds, even when uploading many files at
once.
…On Thu, Jun 23, 2022 at 2:39 AM Trang ***@***.***> wrote:
@ckjpn <https://github.com/ckjpn> Did the audio get uploaded after all?
I'm not seeing any audio to import on https://tatoeba.org/en/audio/import.
FYI there's been a Tatoeba update today that impacts audio uploads among
other things (#2929 <#2929>).
When I deployed the changes, there was some issues at first that I didn't
notice right away. I needed to run some database migration but wasn't
aware. I found out later on and fixed the issues. Perhaps you tried to
upload the audio files while it was not fixed yet.
—
Reply to this email directly, view it on GitHub
<#2955 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AB4RCQPHRAMZIVQWZHOI47DVQNFVPANCNFSM5YSCQLEA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
Progress report: This import apparently took about 2 minutes.
Even a couple of minutes, though, is much longer than it used to take,
which I think was usually under 3 seconds, but definitely under 10 seconds,
even when I was processing large numbers of files.
Started: 22:38 UTC
Import recordingsLast import report (completed on June 22, 2022 at 10:40:22
PM UTC)
A total of 236 recordings have been imported.
236 were Turkish.
…On Thu, Jun 23, 2022 at 7:26 AM Charles Kelly ***@***.***> wrote:
Perhaps these took 6 minutes (3+3) to upload.
Last import report (completed on June 22, 2022 at 10:00:02 PM UTC)
A total of 2 recordings have been imported.
2 were English.
On Thu, Jun 23, 2022 at 6:57 AM Charles Kelly ***@***.***> wrote:
> I just uploaded 2 more audio files, and it's been over 3 minutes and they
> still haven't been uploaded.
>
> Before, it was just a matter of seconds, even when uploading many files
> at once.
>
>
>
> On Thu, Jun 23, 2022 at 2:39 AM Trang ***@***.***> wrote:
>
>> @ckjpn <https://github.com/ckjpn> Did the audio get uploaded after all?
>> I'm not seeing any audio to import on
>> https://tatoeba.org/en/audio/import.
>>
>> FYI there's been a Tatoeba update today that impacts audio uploads among
>> other things (#2929 <#2929>).
>> When I deployed the changes, there was some issues at first that I didn't
>> notice right away. I needed to run some database migration but wasn't
>> aware. I found out later on and fixed the issues. Perhaps you tried to
>> upload the audio files while it was not fixed yet.
>>
>> —
>> Reply to this email directly, view it on GitHub
>> <#2955 (comment)>,
>> or unsubscribe
>> <https://github.com/notifications/unsubscribe-auth/AB4RCQPHRAMZIVQWZHOI47DVQNFVPANCNFSM5YSCQLEA>
>> .
>> You are receiving this because you were mentioned.Message ID:
>> ***@***.***>
>>
>
|
|
Why does it take a very long time sometimes and not so long other times?
Here is the one I'm waiting on now.
I notice that I have to be careful to make sure one import is done before
starting another one by a different "author." Otherwise, files get
uploaded with the wrong username assigned.
Import recordingsAudio import status
Import task enqueued 15 minutes ago. Please refresh the page in a little
while to check if import is completed.
Files detected
A total of 22 files have been detected inside the import directory.
File nameSentence idLanguageExisting audioMay be imported
10903652.mp3 10903652 <https://tatoeba.org/en/sentences/show/10903652>
English None Yes
10902100.mp3 10902100 <https://tatoeba.org/en/sentences/show/10902100>
English None Yes
10908305.mp3 10908305 <https://tatoeba.org/en/sentences/show/10908305>
English None Yes
10908676.mp3 10908676 <https://tatoeba.org/en/sentences/show/10908676>
English None Yes
10910106.mp3 10910106 <https://tatoeba.org/en/sentences/show/10910106>
English None Yes
10910185.mp3 10910185 <https://tatoeba.org/en/sentences/show/10910185>
English None Yes
10903650.mp3 10903650 <https://tatoeba.org/en/sentences/show/10903650>
English None Yes
10910189.mp3 10910189 <https://tatoeba.org/en/sentences/show/10910189>
English None Yes
10903644.mp3 10903644 <https://tatoeba.org/en/sentences/show/10903644>
English None Yes
10900143.mp3 10900143 <https://tatoeba.org/en/sentences/show/10900143>
English None Yes
10903624.mp3 10903624 <https://tatoeba.org/en/sentences/show/10903624>
English None Yes
10903628.mp3 10903628 <https://tatoeba.org/en/sentences/show/10903628>
English None Yes
10903338.mp3 10903338 <https://tatoeba.org/en/sentences/show/10903338>
English None Yes
10903635.mp3 10903635 <https://tatoeba.org/en/sentences/show/10903635>
English None Yes
10903642.mp3 10903642 <https://tatoeba.org/en/sentences/show/10903642>
English None Yes
10903651.mp3 10903651 <https://tatoeba.org/en/sentences/show/10903651>
English None Yes
10908678.mp3 10908678 <https://tatoeba.org/en/sentences/show/10908678>
English None Yes
10903666.mp3 10903666 <https://tatoeba.org/en/sentences/show/10903666>
English None Yes
10935416.mp3 10935416 <https://tatoeba.org/en/sentences/show/10935416>
English None Yes
10903654.mp3 10903654 <https://tatoeba.org/en/sentences/show/10903654>
English None Yes
10910141.mp3 10910141 <https://tatoeba.org/en/sentences/show/10910141>
English None Yes
10903618.mp3 10903618 <https://tatoeba.org/en/sentences/show/10903618>
English None Yes
…On Thu, Jun 23, 2022 at 7:44 AM CK @ Tatoeba Project ***@***.***> wrote:
Progress report: This import apparently took about 2 minutes.
Even a couple of minutes, though, is much longer than it used to take,
which I think was usually under 3 seconds, but definitely under 10 seconds,
even when I was processing large numbers of files.
Started: 22:38 UTC
Import recordingsLast import report (completed on June 22, 2022 at
10:40:22 PM UTC)
A total of 236 recordings have been imported.
236 were Turkish.
On Thu, Jun 23, 2022 at 7:26 AM Charles Kelly ***@***.***> wrote:
> Perhaps these took 6 minutes (3+3) to upload.
>
>
> Last import report (completed on June 22, 2022 at 10:00:02 PM UTC)
> A total of 2 recordings have been imported.
> 2 were English.
>
>
> On Thu, Jun 23, 2022 at 6:57 AM Charles Kelly ***@***.***> wrote:
>
>> I just uploaded 2 more audio files, and it's been over 3 minutes and
>> they still haven't been uploaded.
>>
>> Before, it was just a matter of seconds, even when uploading many files
>> at once.
>>
>>
>>
>> On Thu, Jun 23, 2022 at 2:39 AM Trang ***@***.***> wrote:
>>
>>> @ckjpn <https://github.com/ckjpn> Did the audio get uploaded after
>>> all? I'm not seeing any audio to import on
>>> https://tatoeba.org/en/audio/import.
>>>
>>> FYI there's been a Tatoeba update today that impacts audio uploads
>>> among other things (#2929
>>> <#2929>). When I deployed the
>>> changes, there was some issues at first that I didn't notice right away. I
>>> needed to run some database migration but wasn't aware. I found out later
>>> on and fixed the issues. Perhaps you tried to upload the audio files while
>>> it was not fixed yet.
>>>
>>> —
>>> Reply to this email directly, view it on GitHub
>>> <#2955 (comment)>,
>>> or unsubscribe
>>> <https://github.com/notifications/unsubscribe-auth/AB4RCQPHRAMZIVQWZHOI47DVQNFVPANCNFSM5YSCQLEA>
>>> .
>>> You are receiving this because you were mentioned.Message ID:
>>> ***@***.***>
>>>
>>
|
|
@ckjpn There could be something still misconfigured. I will look into it later. |
|
Perhaps these took 6 minutes (3+3) to upload.
Last import report (completed on June 22, 2022 at 10:00:02 PM UTC)
A total of 2 recordings have been imported.
2 were English.
…On Thu, Jun 23, 2022 at 6:57 AM Charles Kelly ***@***.***> wrote:
I just uploaded 2 more audio files, and it's been over 3 minutes and they
still haven't been uploaded.
Before, it was just a matter of seconds, even when uploading many files at
once.
On Thu, Jun 23, 2022 at 2:39 AM Trang ***@***.***> wrote:
> @ckjpn <https://github.com/ckjpn> Did the audio get uploaded after all?
> I'm not seeing any audio to import on https://tatoeba.org/en/audio/import
> .
>
> FYI there's been a Tatoeba update today that impacts audio uploads among
> other things (#2929 <#2929>).
> When I deployed the changes, there was some issues at first that I didn't
> notice right away. I needed to run some database migration but wasn't
> aware. I found out later on and fixed the issues. Perhaps you tried to
> upload the audio files while it was not fixed yet.
>
> —
> Reply to this email directly, view it on GitHub
> <#2955 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AB4RCQPHRAMZIVQWZHOI47DVQNFVPANCNFSM5YSCQLEA>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Since https://downloads.tatoeba.org/exports/sentences_with_audio.tar.bz2 no longer has all sentences with audio, could you please create another file each week that is similar to this, but that includes all sentences with audio files?
Maybe you could call it all_sentences_with_audio.tar.bz2, Or, perhaps you could just include all sentences with audio like the file used to be.
In addition to what I need, sharptoothed's page relies on this information.
https://tatoeba.j-langtools.com/userchart/chart2.php
The text was updated successfully, but these errors were encountered: