Recover accidentally deleted custom filesRecovering accidentally deleted filesHow to recover a file just...
Can I ask to speak to my future colleagues before accepting an offer?
How can I get edges to bend to avoid crossing?
When are digital copies of Switch games made available to play?
Can I travel from Germany to England alone as an unaccompanied minor?
Does anyone know what these symbols mean?
Needle Hotend for nonplanar printing
Spicket or spigot?
How would an order of Monks that renounce their names communicate effectively?
Is there any problem with this camera not having a lens cover?
Could a Weapon of Mass Destruction, targeting only humans, be developed?
Is there a way for presidents to legally extend their terms beyond the maximum of four years?
How to fix a dry solder pin in BGA package?
What is the name of this OOB notification method/popup, and is it customizable?
What is the highest number of sneak attacks that a Pure/High Level Rogue (Level 17+) can make in one round?
Sum of Parts of An Array - JavaScript
Should I report a leak of confidential HR information?
Meaning of もてり and use of が
Which resurrection spells are valid to use with the Zealot's 'Warrior of the Gods' Feature?
Wrong corporate name on employment agreement
How can a valley surrounded by mountains be fertile and rainy?
Way to find when system health file is rolling over
How did installing this RPM create a file?
Do space suits measure "methane" levels or other biological gases?
How hard is it to sell a home which is currently mortgaged?
Recover accidentally deleted custom files
Recovering accidentally deleted filesHow to recover a file just deletedHow to recover: Deleted accidently important filesHow to recover files I deleted now by running rm *?ecryptfs-recover-private deleted files?Recovering accidentally deleted files, block deviceRecover deleted files using foremostRecover specific files from deleted EXT4 partitionHow to recover my ext4 drive accidentally overwritten by an mkswap?How to recover deleted files in Ubuntu 14.04
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}
I accidentally deleted important custom (not known-or-commercial) files from my scientific researches on image processing.
I created the files by collecting raw digital signals from an image sensor.
Then I raw write the file as byte array and there's no "file signature". The only thing is that the first 200 bytes are reserved for QJSON Object that I store with some watermark information and the following image content size.
Is there any way I could recover the files (around 200GB).
I have tried photorec and testdisk, but they find a lot of .txt/.jpg/.bmp files which don't exists on my Operating System
my HDD structure:
500GB:
sda1 is / -> Ubuntu 14.04 linux root with 57GB ext4
sda2 is extended partition
sda5 is swap partition with 1.5GB
sda6 is /opt with 400GB ext4 formatted with my files on /opt/research-data/rawimages/*.xyz
Extra question: If I dd the hole HDD to a secondary HDD, will the deleted raw images also be dd'ed to the secondary HDD?
What can I do to get my files back?
ubuntu filesystems ext4 data-recovery
edited Mar 9 at 12:53
Rui F Ribeiro
40.6k16 gold badges89 silver badges150 bronze badges
asked Jan 23 at 17:33
shabangshabang
1091 bronze badge
|
show 2 more comments
I accidentally deleted important custom (not known-or-commercial) files from my scientific researches on image processing.
I created the files by collecting raw digital signals from an image sensor.
Then I raw write the file as byte array and there's no "file signature". The only thing is that the first 200 bytes are reserved for QJSON Object that I store with some watermark information and the following image content size.
Is there any way I could recover the files (around 200GB).
I have tried photorec and testdisk, but they find a lot of .txt/.jpg/.bmp files which don't exists on my Operating System
my HDD structure:
500GB:
sda1 is / -> Ubuntu 14.04 linux root with 57GB ext4
sda2 is extended partition
sda5 is swap partition with 1.5GB
sda6 is /opt with 400GB ext4 formatted with my files on /opt/research-data/rawimages/*.xyz
Extra question: If I dd the hole HDD to a secondary HDD, will the deleted raw images also be dd'ed to the secondary HDD?
What can I do to get my files back?
ubuntu filesystems ext4 data-recovery
edited Mar 9 at 12:53
Rui F Ribeiro
40.6k16 gold badges89 silver badges150 bronze badges
asked Jan 23 at 17:33
shabangshabang
1091 bronze badge
1
You can teach custom file formats tophotorecbut it only is reliable for unfragmented files, and in practise unfragmented often means "small in size".
– frostschutz
Jan 23 at 17:42
1
Alternatively,strings -t d -w /dev/partition | grep patternmight help you look for ascii json strings and show you the data offset, so given a plaintext signature, you could script it yourself w/o photorec.
– frostschutz
Jan 23 at 17:51
the hexdump of some other files I have says I have "qbjs" (QJson Object) word on offset 8 and "dateTime" word on offset 34
– shabang
Jan 23 at 17:53
1
Yes, if youddthe whole disk to a second drive you will copy the deleted files as well. If /opt is mounted read/write and you have written anything to /opt (not just /opt/research-data/rawimages) you will probably have destroyed information. So the very first thing to do is get /opt either unmounted. Step 2 is to use dd to copy /dev/sda6 to a new file on another disk. You then read this file 512 bytes at a time, and see if the watermark exists and record the block number and the expected end block based on the length. If there is no overlap you might have identified a file.
– icarus
Jan 26 at 11:16
1
You should stop using the disk immediately, every second that you use it, data is being over written. To stop this happening again, look into revision control tools (svn, hg, and maybe git), and backup.
– ctrl-alt-delor
Jan 27 at 17:52
|
show 2 more comments
I accidentally deleted important custom (not known-or-commercial) files from my scientific researches on image processing.
I created the files by collecting raw digital signals from an image sensor.
Then I raw write the file as byte array and there's no "file signature". The only thing is that the first 200 bytes are reserved for QJSON Object that I store with some watermark information and the following image content size.
Is there any way I could recover the files (around 200GB).
I have tried photorec and testdisk, but they find a lot of .txt/.jpg/.bmp files which don't exists on my Operating System
my HDD structure:
500GB:
sda1 is / -> Ubuntu 14.04 linux root with 57GB ext4
sda2 is extended partition
sda5 is swap partition with 1.5GB
sda6 is /opt with 400GB ext4 formatted with my files on /opt/research-data/rawimages/*.xyz
Extra question: If I dd the hole HDD to a secondary HDD, will the deleted raw images also be dd'ed to the secondary HDD?
What can I do to get my files back?
ubuntu filesystems ext4 data-recovery
edited Mar 9 at 12:53
Rui F Ribeiro
40.6k16 gold badges89 silver badges150 bronze badges
asked Jan 23 at 17:33
shabangshabang
1091 bronze badge
I accidentally deleted important custom (not known-or-commercial) files from my scientific researches on image processing.
I created the files by collecting raw digital signals from an image sensor.
Then I raw write the file as byte array and there's no "file signature". The only thing is that the first 200 bytes are reserved for QJSON Object that I store with some watermark information and the following image content size.
Is there any way I could recover the files (around 200GB).
I have tried photorec and testdisk, but they find a lot of .txt/.jpg/.bmp files which don't exists on my Operating System
my HDD structure:
500GB:
sda1 is / -> Ubuntu 14.04 linux root with 57GB ext4
sda2 is extended partition
sda5 is swap partition with 1.5GB
sda6 is /opt with 400GB ext4 formatted with my files on /opt/research-data/rawimages/*.xyz
Extra question: If I dd the hole HDD to a secondary HDD, will the deleted raw images also be dd'ed to the secondary HDD?
What can I do to get my files back?
ubuntu filesystems ext4 data-recovery
ubuntu filesystems ext4 data-recovery
edited Mar 9 at 12:53
Rui F Ribeiro
40.6k16 gold badges89 silver badges150 bronze badges
asked Jan 23 at 17:33
shabangshabang
1091 bronze badge
edited Mar 9 at 12:53
Rui F Ribeiro
40.6k16 gold badges89 silver badges150 bronze badges
asked Jan 23 at 17:33
shabangshabang
1091 bronze badge
edited Mar 9 at 12:53
Rui F Ribeiro
40.6k16 gold badges89 silver badges150 bronze badges
edited Mar 9 at 12:53
Rui F Ribeiro
40.6k16 gold badges89 silver badges150 bronze badges
edited Mar 9 at 12:53
Rui F Ribeiro
40.6k16 gold badges89 silver badges150 bronze badges
40.6k16 gold badges89 silver badges150 bronze badges
asked Jan 23 at 17:33
shabangshabang
1091 bronze badge
asked Jan 23 at 17:33
shabangshabang
1091 bronze badge
asked Jan 23 at 17:33
shabangshabang
1091 bronze badge
1091 bronze badge
1
You can teach custom file formats tophotorecbut it only is reliable for unfragmented files, and in practise unfragmented often means "small in size".
– frostschutz
Jan 23 at 17:42
1
Alternatively,strings -t d -w /dev/partition | grep patternmight help you look for ascii json strings and show you the data offset, so given a plaintext signature, you could script it yourself w/o photorec.
– frostschutz
Jan 23 at 17:51
the hexdump of some other files I have says I have "qbjs" (QJson Object) word on offset 8 and "dateTime" word on offset 34
– shabang
Jan 23 at 17:53
1
Yes, if youddthe whole disk to a second drive you will copy the deleted files as well. If /opt is mounted read/write and you have written anything to /opt (not just /opt/research-data/rawimages) you will probably have destroyed information. So the very first thing to do is get /opt either unmounted. Step 2 is to use dd to copy /dev/sda6 to a new file on another disk. You then read this file 512 bytes at a time, and see if the watermark exists and record the block number and the expected end block based on the length. If there is no overlap you might have identified a file.
– icarus
Jan 26 at 11:16
1
You should stop using the disk immediately, every second that you use it, data is being over written. To stop this happening again, look into revision control tools (svn, hg, and maybe git), and backup.
– ctrl-alt-delor
Jan 27 at 17:52
|
show 2 more comments
1
You can teach custom file formats tophotorecbut it only is reliable for unfragmented files, and in practise unfragmented often means "small in size".
– frostschutz
Jan 23 at 17:42
1
Alternatively,strings -t d -w /dev/partition | grep patternmight help you look for ascii json strings and show you the data offset, so given a plaintext signature, you could script it yourself w/o photorec.
– frostschutz
Jan 23 at 17:51
the hexdump of some other files I have says I have "qbjs" (QJson Object) word on offset 8 and "dateTime" word on offset 34
– shabang
Jan 23 at 17:53
1
Yes, if youddthe whole disk to a second drive you will copy the deleted files as well. If /opt is mounted read/write and you have written anything to /opt (not just /opt/research-data/rawimages) you will probably have destroyed information. So the very first thing to do is get /opt either unmounted. Step 2 is to use dd to copy /dev/sda6 to a new file on another disk. You then read this file 512 bytes at a time, and see if the watermark exists and record the block number and the expected end block based on the length. If there is no overlap you might have identified a file.
– icarus
Jan 26 at 11:16
1
You should stop using the disk immediately, every second that you use it, data is being over written. To stop this happening again, look into revision control tools (svn, hg, and maybe git), and backup.
– ctrl-alt-delor
Jan 27 at 17:52
1
1
You can teach custom file formats to
photorec but it only is reliable for unfragmented files, and in practise unfragmented often means "small in size".– frostschutz
Jan 23 at 17:42
You can teach custom file formats to
photorec but it only is reliable for unfragmented files, and in practise unfragmented often means "small in size".– frostschutz
Jan 23 at 17:42
1
1
Alternatively,
strings -t d -w /dev/partition | grep pattern might help you look for ascii json strings and show you the data offset, so given a plaintext signature, you could script it yourself w/o photorec.– frostschutz
Jan 23 at 17:51
Alternatively,
strings -t d -w /dev/partition | grep pattern might help you look for ascii json strings and show you the data offset, so given a plaintext signature, you could script it yourself w/o photorec.– frostschutz
Jan 23 at 17:51
the hexdump of some other files I have says I have "qbjs" (QJson Object) word on offset 8 and "dateTime" word on offset 34
– shabang
Jan 23 at 17:53
the hexdump of some other files I have says I have "qbjs" (QJson Object) word on offset 8 and "dateTime" word on offset 34
– shabang
Jan 23 at 17:53
1
1
Yes, if you
dd the whole disk to a second drive you will copy the deleted files as well. If /opt is mounted read/write and you have written anything to /opt (not just /opt/research-data/rawimages) you will probably have destroyed information. So the very first thing to do is get /opt either unmounted. Step 2 is to use dd to copy /dev/sda6 to a new file on another disk. You then read this file 512 bytes at a time, and see if the watermark exists and record the block number and the expected end block based on the length. If there is no overlap you might have identified a file.– icarus
Jan 26 at 11:16
Yes, if you
dd the whole disk to a second drive you will copy the deleted files as well. If /opt is mounted read/write and you have written anything to /opt (not just /opt/research-data/rawimages) you will probably have destroyed information. So the very first thing to do is get /opt either unmounted. Step 2 is to use dd to copy /dev/sda6 to a new file on another disk. You then read this file 512 bytes at a time, and see if the watermark exists and record the block number and the expected end block based on the length. If there is no overlap you might have identified a file.– icarus
Jan 26 at 11:16
1
1
You should stop using the disk immediately, every second that you use it, data is being over written. To stop this happening again, look into revision control tools (svn, hg, and maybe git), and backup.
– ctrl-alt-delor
Jan 27 at 17:52
You should stop using the disk immediately, every second that you use it, data is being over written. To stop this happening again, look into revision control tools (svn, hg, and maybe git), and backup.
– ctrl-alt-delor
Jan 27 at 17:52
|
show 2 more comments
1 Answer
1
active
oldest
votes
you need to stop using the disk, and if all the ways are unavailable, try a data recovery tool to get your data back
answered 1 hour ago
AmilybaiAmilybai
1
New contributor
Amilybai is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f496269%2frecover-accidentally-deleted-custom-files%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
you need to stop using the disk, and if all the ways are unavailable, try a data recovery tool to get your data back
answered 1 hour ago
AmilybaiAmilybai
1
New contributor
Amilybai is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
you need to stop using the disk, and if all the ways are unavailable, try a data recovery tool to get your data back
answered 1 hour ago
AmilybaiAmilybai
1
New contributor
Amilybai is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
you need to stop using the disk, and if all the ways are unavailable, try a data recovery tool to get your data back
answered 1 hour ago
AmilybaiAmilybai
1
New contributor
Amilybai is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
you need to stop using the disk, and if all the ways are unavailable, try a data recovery tool to get your data back
answered 1 hour ago
AmilybaiAmilybai
1
New contributor
Amilybai is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
answered 1 hour ago
AmilybaiAmilybai
1
New contributor
Amilybai is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
answered 1 hour ago
AmilybaiAmilybai
1
answered 1 hour ago
AmilybaiAmilybai
1
1
New contributor
Amilybai is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Amilybai is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f496269%2frecover-accidentally-deleted-custom-files%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
You can teach custom file formats to
photorecbut it only is reliable for unfragmented files, and in practise unfragmented often means "small in size".– frostschutz
Jan 23 at 17:42
1
Alternatively,
strings -t d -w /dev/partition | grep patternmight help you look for ascii json strings and show you the data offset, so given a plaintext signature, you could script it yourself w/o photorec.– frostschutz
Jan 23 at 17:51
the hexdump of some other files I have says I have "qbjs" (QJson Object) word on offset 8 and "dateTime" word on offset 34
– shabang
Jan 23 at 17:53
1
Yes, if you
ddthe whole disk to a second drive you will copy the deleted files as well. If /opt is mounted read/write and you have written anything to /opt (not just /opt/research-data/rawimages) you will probably have destroyed information. So the very first thing to do is get /opt either unmounted. Step 2 is to use dd to copy /dev/sda6 to a new file on another disk. You then read this file 512 bytes at a time, and see if the watermark exists and record the block number and the expected end block based on the length. If there is no overlap you might have identified a file.– icarus
Jan 26 at 11:16
1
You should stop using the disk immediately, every second that you use it, data is being over written. To stop this happening again, look into revision control tools (svn, hg, and maybe git), and backup.
– ctrl-alt-delor
Jan 27 at 17:52