TypeError : 'byte' and 'str'

in Python3,  'byte'  type was introduced.
It might make TypeErr if run in Python2 and Python3

https://stackoverflow.com/questions/33054527/typeerror-a-bytes-like-object-is-required-not-str-when-writing-to-a-file-in


you can convert 'byte' to 'str'

strType=byteType.decode("utf-8")

https://stackoverflow.com/questions/606191/convert-bytes-to-a-string

python numpy.isin - implement of matlab's ismember(A, B)

https://docs.scipy.org/doc/numpy/reference/generated/numpy.isin.html?highlight=numpy%20isin#numpy.isin

mask = np.isin(A, B)

idx=np.nonzere(mask) # return index of element A which is in element B

 

numpy.isin(element, test_elements, assume_unique=False, invert=False)[source]

Calculates element in test_elements, broadcasting over element only. Returns a boolean array of the same shape as element that is True where an element of element is in test_elements and False otherwise.

Parameters:

element : array_like Input array. test_elements : array_like The values against which to test each value of element. This argument is flattened if it is an array or array_like. See notes for behavior with non-array-like parameters. assume_unique : bool, optional If True, the input arrays are both assumed to be unique, which can speed up the calculation. Default is False. invert : bool, optional If True, the values in the returned array are inverted, as if calculating element not in test_elements. Default is False. np.isin(a, b, invert=True) is equivalent to (but faster than) np.invert(np.isin(a, b)).

Returns:

isin : ndarray, bool Has the same shape as element. The values element[isin] are in test_elements.

Linux comm command

http://www.unixcl.com/2009/08/linux-comm-command-brief-tutorial.html


From COMM(1) man page, the options available are:

-1 suppress lines unique to FILE1
-2 suppress lines unique to FILE2
-3 suppress lines that appear in both files

comm - compare two sorted files line by line

comm <(sort a.txt) <(sort b.txt)

Sed Command in Linux

Replacing all the occurrence of the pattern in a line : The substitute flag /g (global replacement) specifies the sed command to replace all the occurrences of the string in the line.

$sed 's/apple/lemon/g' test.txt

https://www.tecmint.com/linux-sed-command-tips-tricks/


https://www.geeksforgeeks.org/sed-command-in-linux-unix-with-examples/

https://likegeeks.com/sed-linux/

Redirect stderr and stdout in Bash

https://stackoverflow.com/questions/637827/redirect-stderr-and-stdout-in-bash


You can redirect stderr to stdout and the stdout into a file:

some_command >file.log 2>&1 

To append file
echo "foo" 1>> bar.txt 2>&1 

FastQC read duplication report

clear description of fastQC read duplication report and example

https://www.biostars.org/p/107402/