Previously rhymes with:
enviously, obviously, contemporaneously, curiously, enviously, erroneously, extraneously, furiously, gloriously, harmoniously, hideously, hilariously, indubiously, instantaneously, laboriously, mysteriously, notoriously, obviously, precariously, seriously, simultaneously, spontaneously, studiously, tediously, unceremoniously, variously, vicariously
Previously sounds like:
profusely, proposal, purposely