Again, it is a limiting and misleading definition to say religion is just about worship of god. A religion, in the broader sense is anything which has beliefs, moral codes and rituals. This is the definition Emile Durkheim uses in sociology.
There are some religions which have nothing to do with a worship of god. Taoism for instance is all about the Tao, the universal force, the flow. Yet Taoism has a whole host of metaphysical belief, rituals, deities and moral codes.
Similarly, while Buddhism does not worship god. It gives religious significance to void and nothingness. While Buddha did not say worship me, many of the Buddhist rituals involve worshipping an idol of Buddha, invoking his name, burning incense, chanting mantras, repeating religious vows and ones allegiance to the sangh. Some forms of Buddhism very clearly worship minor deities. The Buddhist 8-fold path very much dictates a moral practice.
Secular traditions differ from religious traditions because they only endorse the natural and remain silent on the metaphysical. They do not impose any kind of moral codes on you or beliefs on you, other than laws of the state. They largely remain neutral on these matters. Science and academia are secular traditions.
Buddhism is not secular. It is misleading and disingenious to tell somebody that Buddhism is secular/non religious.
Even though I claim that Hinduism is through and through a science. I will not go as far to say it is not religious. It is clear to anybody who has eyes that it is religious. It is a scientific and philosophical religion. It is religion because it has a whole host of metaphysical doctrines, moral codes, rituals and practices. It is a science because those doctrines, moral codes, rituals and practices are grounded in rationality.